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SHAWN POWERS 


Mobile Computing: 
When Size Matters 


echnology is funny. Not too 
T many years ago, the goal was 

to make a cell phone as tiny as 
technologically possible. Now, phones 
like the Galaxy Note are striving for 
aircraft-carrier size. This month, 
whether you want to embed a phone 
into your sneaker or play hopscotch 
in order to dial your buddy, we've got 
you covered. Mobile devices can do 
almost anything traditional computer 
systems can do, and oftentimes, they 
can do it better. 

Reuven M. Lerner starts the issue off 
with logging. No, he doesn’t show how 
to cut down trees with our Razr, but 
rather he talks about the importance 
of making applications that keep a 
log. Logs are really pointless, until you 
need them. Then, they're invaluable. 
If you need more convincing, listen to 
Reuven; you can trust him to lead you 
in the right direction. Dave Taylor, on 
the other hand, | don’t recommend 
trusting—at least not in a game of 
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Scrabble. Dave continues his series 
on how to be a lying, cheating, filthy, 
jerk—for educational purposes only, 
of course! In all seriousness, Dave 
explores some really cool scripting 
using a very practical, if nefarious, 
object lesson. 

Our king of nefarious, Kyle Rankin, 
finishes his series on password 
cracking in this issue. By this time, 
you've all learned how to do brute- 
force attacks with a GPU, so Kyle 
spends this month explaining how to 
tweak things so you can get the most 
hack for your buck. | follow Kyle’s 
“educational” article with the second 
installment of my new column, The 
Open-Source Classroom. This month, 
| start a series on LTSP. Thin clients 
have evolved a lot since | started using 
them back in 2001 or so. I'll walk you 
through setting up a lab, and in the 
next few issues, l’ll teach you how to 
tweak the system. Kyle probably will 
follow up with a tutorial on using the 


As someone who constantly thinks tablet computers 
would be great if they had hinges and keyboards, 
I’m interested in alternative interfaces! 


distributed CPU power of thin clients 
to break in to the local 7-11, but you'll 
have to wait and see. 

Mark O'Connor shows how to use 
Linux on an iPad. No, probably not 
how you think, but rather, he explains 
how to use Linode on an iPad in 
order to do your work in the cloud. 

If you want the convenience of an 
iPad with the power and flexibility 
of Linux, Mark's solution is worth a 
look. Bill Childers does a similar feat 
with his article on IRC proxying to 
mobile devices. I’ve been using Irssi 
in a Screen session for all my instant 
messaging for a few months now, 
but I'll admit it’s rough when I’m 
out and about. Logging in to Irssi on 
a software-keyboard over SSH isn't 
terribly fun on a phone. Bill describes 
how to get the best of both worlds, 
and at the same time! 

Rebecca “Ruji” Chapnik also delves 
into the command line, but instead 
of bridging IRC to a mobile device, 
she shows how to play music from 
the console. Many Linux users think 
Ncurses is as GUI as an application 
ever needs to get (ahem, Kyle Rankin), 
and Rebecca shows how to use the 


command line to its fullest extent. 
Stuart Jarvis heads in the opposite 
direction and talks about Plasma 
Active. Tablet computing is still 
quite young, and the interfaces we 
use on touchscreen devices are far 
from perfect. Stuart describes what 
KDE is doing to address tablets and 
touchscreen devices. As someone who 
constantly thinks tablet computers 
would be great if they had hinges 
and keyboards, I’m interested in 
alternative interfaces! 

Don’t worry if you prefer your Linux 
more “desktoppy” than mobile. This 
is Linux Journal, and we always have a 
variety of articles that will tickle every 
geek’s interest. Whether you want to 
continue the series on EFI with Roderick 
W. Smith, or explore the world of 
cryptocurrency with me, this issue has 
lots to offer. As always, we hope you 
enjoy this issue, we sure did.m 


Shawn Powers is the Associate Editor for Linux Journal. He's also 
the Gadget Guy for LinuxJournal.com, and he has an interesting 
collection of vintage Garfield coffee mugs. Don’t let his silly hairdo 
fool you, he’s a pretty ordinary guy and can be reached via e-mail 
at shawn @linuxjournal.com. Or, swing by the #linuxjournal IRC 
channel on Freenode.net. 
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Kindle 
Edition 
OLS of LJ 


pullin Mordiis | Ronee | love the 
SECURITY Biss 


version of 
pe i LJ. It makes 
reading LJ 
on the Kindle 
absolutely 
fantastic. 
But, I’ve got 
one request: every Kindle account has 
an @kindle.com e-mail to which you 
can send PDF/.mobi/... files, and they 
are added to your Kindle automatically 
when you switch on Wi-Fi. So instead 
of sending an e-mail with download 
links, can you make it an option to 
send the .mobi version straight to 
my @kindle.com address? Then, I'll 
just have to turn on the Wi-Fi on 
my Kindle, and I'll be able read the 
newest issue of LJ. 
—Ward 


SlickEdit—a 
Swiss Army Knife. 
for-Programimers 


a Patarioid Penguin 
Retfospective 


Examining 
ELF VIRUSES 


Hmm, I'll make sure our distribution 
folks see your request. Another 
option might be a script that pulls 
links from your e-mail, downloads 
the .mobi, and then re-sends it to a 
specified account as an attachment. 
Perhaps it’s a good challenge for 
Dave Taylor!—Ed. 
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Ultimate Linux Box 

Browsing through the e-copies of 

my subscription, | found issue 148, 
the Ultimate Linux Box issue from 
2006. Back then, dual-core processors 
were just becoming affordable for 

the common user, AMD launched its 
AM2 platform with the 939 socket, 
and DDR2 was emerging as the 

new standard in memory speed and 
performance. That was nearly six years 
ago. Maybe it’s time to revisit the 
subject and make a comparison with 
today’s technologies that make the 
Ultimate Linux Box? (And, (dis)prove 
the predictions of 2006 for the years 
ahead with the benefit of history.) 


Having built a fair number of computers 
myself, mainly for myself, | could send 
you some proposed configurations if 
you'd like. Unfortunately, | didn’t win 
the lottery, again, so | don’t have the 
budget to build them myself and put 
them through their passes/benchmarks. 
—Vincent Westein 


We did stop with the Ultimate Linux Box 
a while back, for several reasons. The 
biggest one was that “Ultimate” became 
so relative. For our Christmas-wish list, 
we did throw a configuration together, 
but | suspect it wouldn't be ideal for 
everyone. | agree though. | miss the 


issues highlighting rigs I’d never be able 
to afford. It was like looking at a geeky 
hot-rod magazine.—Ed. 


Electronic vs. Print 

Although | completely understand 
the economic necessity of publishing 
electronically—after all, you prepare, 
edit and produce the copy electronically, 
and it’s easy enough to generate 
multiple formats for consumption 

on any number of devices—! have 
concerns, or perhaps observations 
might be the right word, about the 
longevity of the material. 


For many years | have kept issues of 
magazines—National Geographic, 
Scientific American, Creative Computing 
(remember that one?), Linux Journal 
and a few others. | have also, at least 
in the case of Linux Journal, bought 
the CD-ROM archive. | did buy the 
National Geographic every-issue-since- 
volume 1, number 1. | have 9-track 
tapes (UNIX System V, World Data Bank 
Il and a couple others). | have cassette 
tapes (music), reel-to-reel tapes (live 
performances), CD-ROMs, DVDs, 
Blue-ray discs and a few disk drives 
lying about along with a personal 
library of some 2,000 books. 


One thing I’ve noticed: | still can 


| LETTERS | 


read the hard copies, but most of 

the magnetic media is gone. Many 
CD-ROMs are gone, but | still can play 
records from the 1940s through today, 
and they “sound just as good” as 
they did then. | was more than a little 
Surprised to discover that CD-ROM 
media just five years old had become 
useless, and a small collection of 

laser discs are unwatchable. So-called 
archive media, supposed to last 
decades (decades! ?) is turning out 

to be somewhat less long-lived. 


| have stood in the Bodleian Library at 
Oxford with a 600-year-old book in my 
hands (with gloves, of course) and read 
every word. | have stood in the British 
Museum in London and read a letter 
written by Elizabeth Tudor to her half- 
brother, then king of England, in the 
16th century. | have admired Egyptian 
scrolls dating from 4,000 years ago 
(not decades, mind, millenniums). 


| have long been painfully aware that the 
attention span of a computer is only as 
long as its power cord. | am becoming 
aware that our attention spans are ever 
shorter as our gadgets display fleeting 
glimpses of our civilization, glances 
destined to go “poof” in the ether 
when the battery goes dead. Alas. 
—Thomas Ronayne 
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Your concern is, unfortunately, very 
valid. | say this as a man responsible for 
keeping a microfiche system working, 
because archiving in microfiche is 

the “way of the future”. My only 
encouragement is that a digital format 
is generally easier to manipulate than 
physical media. Although a small script 
can convert many documents, I’ve yet 
to find an affordable scanner to read 
microfiche. Since | can still read my 
Usenet postings from the early 1990s, 
perhaps there is some hope for long- 
term viability.—Ed. 


LJ Deserves the Benefit of the Doubt 
| wasn’t planning to renew my 
subscription to the magazine, my 
instinctive reaction being against any 
form of digital format. But, today | 
got your 2012 January issue and with 
it your reader letters, and at least a 
couple mentioned how much better 
digital is than dead trees for the 
environment. Although the jury isn’t 
out on this one (a printed magazine 
nowadays should be done from 
renewable carbon-neutral sources, and 
digital media means burning fossil fuel 
to power all those severs and fancy 
gadgets), my gut feeling is digital is 
better in this regard. | also saw the 
table of contents with highly technical 
security topics. Finally, | have bought 
your magazine in the three countries 
where | have lived from quite early 

on, sometimes providing the only bit 
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of uncensored Western media | had 
access to. 


In conclusion, | will give the magazine a 
spin in its new form, but please, keep it 
Linux. Sometimes you deviate so much 
from just Linux that it’s not funny. Now 
that you are charging for bytes displayed 
on screen, you have to focus on what the 
magazine is all about (or make explicit 
the wider aims of the magazine, but that 
is another can of worms I’m sure you 
don’t want to open at this time). 

—Jose Luis Martinez 


I’m starting to get used to the digital 
format myself, and although my home 
still might be full of paper books, | find 
/ read more on my Sony e-reader than 
anything else. | suspect my kids will 
grow into adults who prefer to read on 
their mobile devices. |’m not sure how | 
fee! about that! 


As far as content goes, we try to focus 
on Linux and open source. We do 

have a “Non-Linux FOSS” blurb in our 
Upfront section every month, but it’s 
tiny. We try to choose articles that are 
interesting to Linux users. Usually, that 
means Linux-specific, but sometimes 
the scope is a little broader.—Ed. 


Digital Format for Magazines 
Although | think the format could still use 
some tweaking, | have been waiting for 
this for a couple years. | had pretty much 


quit subscribing to any print publications 
a couple years ago because | have gotten 
tired of all the paper lying about. | think 
your short-lived sister publication TUX is 
what finally pushed me over. 

—Jim Gribbin 


TUX was published before | was on staff 
with Linux Journal, and | too was sad to 
see it go. | still have every issue lovingly 
preserved. I’m personally excited about 
the different distribution options we 
have electronically. The same content 
can be manipulated to work in multiple 
ways. It’s pretty cool.—Ed. 


YNAB, YNOT 

In your January 2012 issue's Upfront 
section, YNAB is listed as a Linux- 
supported budget application. 
Unfortunately, a couple months ago, 
Adobe discontinued Linux support in AIR. 
—davbran 


Ugh, tell me about it. In fact, | mentioned 
YNAB for multiple reasons. One, | think 
it’s a great program, and | figured other 
Linux users might like it as well. | also 
wanted to mention YNAB in our magazine 
specifically, so the company would see 
Linux users as a viable customer base, 

not just something supported because 
AIR happens to be cross-platform. Will 
YNAB see a mention in a prominent Linux 
magazine as a sign that it should continue 
Linux support? | don’t know, but it’s 
possible. Will Adobe read it and decide to 
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resume its Linux support? Less likely, but | 
guess there is some hope. 


Nevertheless, YNAB works on the last- 
released Linux version of AIR, and since 

| personally use it and think it’s a great 
program, | mentioned it. As far as AIR 
support goes, that really frustrates me, 
because I’ve given Adobe a lot of positive 
lip service during the past few years for 
supporting Linux. Grrrr.—Shawn 


Advertising? 

As | was reading the latest issue 
(January 2012), | couldn’t help but 
wonder whether you are being paid 
for the articles such as the one 

on YNAB in the Upfront section. 

They almost come across as blatant 
advertising! To include YNAB is a bit 
of stretch—the only tie to Linux being 
the Android app! Don’t get me wrong; 
it provided me with the motivation 

to start using it, but it would be nice 
to know whether you are receiving 
money for this advertisement. 

—Josh 


No, the journalistic side of Linux Journal 
generally has very little contact with the 
advertising side. If | do something where 
a company has paid, | make it very clear, 
saying “This XXXXX was sponsored by 
the fine folks at Springy Widgets dot- 
com”, or something like that. 


For the UpFront part of the magazine, 
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| try to find things that interest me as a 
Linux user and share them. Sometimes 
my Interests line up with readers better 
than others, but rest assured, it’s just 
me. (| tend to be absent-minded and 
forget to keep track of finances, thus 
my mention of YNAB.) 


PS. I’m also hoping the folks at YNAB 
will keep their product Linux-compatible 
too, since Adobe dropped AIR support. 
Hopefully, mentioning them in a Linux 
magazine will show them (or Adobe) that 
we're customers too dag nabbit! 


Switch to Electronic-Only 

Regarding some comments on the recent 
switch to electronic-only publishing: 

| always liked Linux Journal, but | 
always thought it was too expensive 

to subscribe to. Then when LJ became 
electronic-only, it was only $20 to 
subscribe, and I’m glad | did. I’ve been 
enjoying reading the archived back 
issues that you thankfully included in 
the subscription price, and the new 
issues seem to be maintaining the same 
quality. As far as print versus electronic, 
| have shelves full of my favorite 
magazines in my basement that | save 
because | can’t bear to throw them out, 
thinking that “someday”, say, when | 
retire, I'll go back and read them again, 
but who knows if that will ever happen. 
Having the issues on hand electronically 
makes them much more available to me 
on any device that can read them, which 
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is good. But, I’m surprised to see you 
still going with the two-column format 
like you did in print. This means when 
I'm reading the .pdf, | have to use the 
arrow keys to go up and down each 
page, then page down to get to the next 
page, then use the up and down arrows 
again. Since you are now electronic-only, 
a single-column format to eliminate 

the arrowing up and down would be 
better (lots of your readers are older 

like me and can’t read at a resolution 
that would put one page on the screen). 
Keep up the good work, and I'm glad to 
be a subscriber finally. 

—Frank Palmeri 


Glad to have you as a subscriber, Frank 
(“One of Us. One of Us”). Seriously 
though, the two-column layout for the 
PDF is designed for folks who prefer the 
traditional magazine look. The mobile 
versions (.epub and .mobi) have flowing 
text, so the up/down-back/forth scrolling 
shouldn't be required.—Ed. 


Electronic LJ 

| bought my Xoom primarily to be able 
to read PDFs comfortably—including 
Linux Journal in PDF form. The new 
two-column format works beautifully on 
Xoom. Also, | get all the graphics as well 
as the sense that I’m reading a magazine. 


I'm not a fan of .epub for anything but 
plain straight text (novels, for example). I’ve 
gotten several computer books from Kindle, 
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and on the Kindle reader, they’re useless. Good Work on the Digital Editions 
| can get by reading them on the Xoom, but __| was a bit disappointed when you 

the code samples—and those are crucial, of | converted all subscriptions to digital, 
course—have virtually unreadable layout. because | liked the printed edition. But 


The same goes for trying to read poetry after some months, | can say you guys 

on a Kindle. So, please don’t abandon rock. The PDFs are okay, but the native 
the magazine-like PDF versions. applications for iPad and Android and the 
—Eric Beversluis .epub version and the .mobi versions are 


really worth the subscription. 
We don’t have any plans to abandon 
the PDF, and | agree that PDFs look Despite the really good work you 
great on tablet computers. We do keep already do, | dare suggest one more 
trying every month to improve the code _ thing. Why not integrate to iOS 
layout on mobile reading devices, but it Newsstand? | mean, don’t abandon the 
is a challenge.—Ed. native application for devices without 
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iOS v.5, but it would be nice to have 
it integrated to the Newsstand. Thank 
you for the good job; I’m going to 
renew my subscription for sure. 
—Lorenzo Lazzeri 


Integrating with the various storefronts 
is something we're researching, but it’s 
a complex endeavor. Hopefully, someday 
Linux Journal will be available seamlessly 
on any platform. Right now, the iOS 

app is the best way to get automatic 
delivery.—Ed. 


ELF Virus, Part |—Program Bug 

| read with interest Himanshu Arora’s 
article, “ELF Virus, Part 1”, in the January 
2012 issue of Linux Journal. However, 

| discovered a bug in his code that will 


cause the program to fail in certain cases. 


Near the end of the infect() routine, 
he uses the rename() function to 
rename the modified executable back to 
its original name. This call will fail if /tmp 
and /home are on different filesystems, 
as they are on my system. 


My workaround was to change the 
#define TMPLATE directive to a temporary 
file on the same filesystem as /home. A 
more robust alternative would be to test 
for the potential error condition and use 
a system() call to move the file, or 

use write() to replace the original file. 
Thank you for the interesting article. | 
look forward to following this series. 
—Mark Anthony 


16 / MARCH 2012 / WWW.LINUXJOURNAL.COM 


Himanshu Arora replies: First, thanks 
for reading the article. Regarding the 
issue you pointed out, | don’t think 
that it’s a bug. It’s one of those many 
scenarios in which the rename () 
function errors out. | have done proper 
error handling in the code for this. 


Your suggestion can well be addressed 
as an enhancement to the code in 

the sense that the logic won't error 
out if rename() fails. This comment 
could well apply to many of the other 
system calls used in my code. Because 
this code was more of a proof of 
concept rather than an actual virus, | 
refrained from adding such complexity 
to the code. 


Anyway, | appreciate your hard work and 
would like to thank you for your review. 


Product of the Year: GNOME 3??? 
| have long considered Linux Journal 
to be a reliable source of information, 
but declaring GNOME 3 as Product 

of the Year is really disappointing to 
me (see the Readers’ Choice Awards 

in the December 2011 issue). | find it 
pretty hard to believe that this could be 
voted on as Product of the Year. It has 
been widely accepted in many, many 
forums that GNOME 3 is a huge step in 
the wrong direction. As a reader and 
longtime Linux user, | find it hard to 
believe that this is what voters said. 
—Morocho Ni 


COLUMBIA, SC 
sue MARCH 28 AND 29 


se 2012 
* POSSCON 


PALMETTO OPEN SOURCE SOFTWARE CONFERENCE 


6 


JOIN US FOR THE BEST SPEAKERS, TOPICS AND SOCIAL EVENTS IN THE COUNTRY 


POSSCON.ORG 
MARCH 28 & 29, 2012 | COLUMBIA, SC 
presented by 


Bringing Op rce to the Southeast 


DEVELOPERS — EDUCATORS — IT LEADERS IN BUSINESS, GOVERNMENT, HEALTHCARE AND SECURITY 


| LETTERS | 


Readers voted; we counted the votes 
and reported. Perhaps those users who 
don’t like GNOME 3 simply didn’t vote. 
| don’t know. Rest assured, however, 
we report what we see.—Ed. 


Amazon Cloud Articles? 

| am a subscriber and love this 
magazine. | have experimented with 
running Linux instances in the Amazon 
cloud, but | do not yet actually 

know enough about the process to 
accomplish any serious work. It would 
be extremely useful to me, and | am 
sure for others like me, to have a 
complete article or series of articles 
on spinning up Linux on AWS; creating 
an Amazon machine image (AMI) from 
scratch; converting a virtual box, Xen, 
or VMware virtual machine to an AMI; 
setting up a distributed computing 
task (such as data mining) on AWS; 
running special-purpose applications 
(like “Big Blue Button”) and so on. 

In other words, practical, in-depth 
treatment/tutorials on how to use 

the Amazon cloud for business and 
personal-computing solutions. | hope 
you will consider running such an 
article or set of articles. 

—RAB 


Thanks for your suggestions—we ll see 
what we can do!—Ed. 


LJ Digital Format 
| just purchased a Kindle to be able to 
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view the new LJ digital format, and so 
far, | think | am liking the change. | 
wasn’t sure if this old dog could learn 
a new trick, but | think | have accepted 
the change. One request | would like 
to make is converting the old archives 
(1994-2011), which are currently 
available on a DVD, to the new digital 
format. If those were available in the 
mobi file format for the Kindle, | 
would be first in line to place an order 
for such a product and probably many 
others would be interested as well. 
—Gary Stout 


Great minds think alike—we’re actually 
working on converting some archives 
now. See http://www.linuxjournal.com/ 
ebook for more information. 


Frink Programming Language 

May | suggest an article on the Frink 
programming language? | think it’s 
really neat and deserves a lot of atten- 
tion from the Linux community. Here 
are some links to whet your appetite: 
http://futureboy.us/frinkdocs 

and http://confreaks.net/videos/ 
120-elcamp2010-frink?player=flash 
(a quick video presentation). It’s also 
available as an Android install and has 
access to most, if not all, of the device's 
features (http://futureboy.us/frinkdocs/ 
android.html). 

—Leon 


Thanks Leon, it looks cool!—Ed. 


Google Currents Edition? 

If you guys haven't considered it already, you 
definitely should look into a Google Currents 
edition of LJ. Google Currents is an Android/iOS 
app that displays various publications and 
blogs. Even if you were unable to put the actual 
magazine into Currents (not sure how paid 
content works), the various reviews, blog posts 
and how-to articles on your Web site would be 
a welcome addition! 

—Paul 


We have started looking into Google Currents, 
but we do have a native Android app that will 
download the issue automatically every month. It 
pulls in articles from our Web site as well. If you 
haven’t played with it, be sure to check it out. It’s 
free in the Android Marketplace.—Ed. 


You Won Me Over 


Okay, | have to admit | was mad about the all-digital 


option at first. It look me a couple months before 
| sat down to configure my iPad to connect to my 
account. | can’t believe how easy it was to get 

things going. Reading the content on my iPad has 


been a great experience. It’s a new way of reading! 


| like getting the new monthly issue right away. 
| have to say, you won me over, and best of all, 
digital means LJ will stick around! 

—Sean Humphrey 


Hooray! | too enjoy seeing the full-color magazine 


on a tablet computer. It seems almost more vivid 
than the printed magazine was!—Ed. 
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WHAT’S NEW IN KERNEL DEVELOPMENT 


Tim Bird has started up the 
Android Mainlining Project, an 
attempt to create an organized 
flow of Android features back into 
the main kernel source. One of 
Linux's most fun qualities is that 
it'll compile and run unmodified on 
more devices than you can count. 
This is rarely by chance. In most 
cases, someone, or several people, 
are responsible for maintaining 
support on that architecture. 
Usually, that support is developed 
inside the official kernel from the 
start. In the case of the Android 
OS, Google forked off a copy 

of the kernel sources and had 

its teams make the extensive 
modifications necessary to run on 
Android devices. Given the high 
degree of “drift” that tends to 
come between code bases when 
that happens, Tim's project is 
pretty timely. Eventually, the entire 
Android OS may be reduced to a 
simple set of configuration variables 
and a lot of userspace software. 
Currently, it’s configuration 
variables, userspace software and 
a whole lot of kernel patches. 
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Linus Torvalds once said that 
Al Viro had the uncanny ability 
to organize his kernel patches so 
that each one did some small thing 
that was obviously good. Although 
the great mass of his patches, 
taken as a whole, somehow also 
would manage to advance the 
kernel at large, advancing the 
broader goals of developing the 
VFS (Virtual Filesystem). 

The VFS is not necessarily 
glamorous work, existing as it does 
almost entirely beneath anything 
the user can actually see. But, Al’s 
work forms the underpinnings of 
every filesystem supported by Linux. 

One little invisible thing he did 
lately was start cleaning up the 
vfsmount data structure, so that 
it wouldn't export a lot of VFS- 
specific data to the wider kernel 
world, but would take the cleaner 
approach of exporting only the data 
that non-VFS code might actually 
need. And, in keeping with Linus’ 
comment of long ago, he was 
Organizing the change so as to 
cause the smallest possible impact 
on the rest of the kernel, while 


paving the way for further cleanups 
in the future. 

What often happens with 
complex new technologies is 
that several people get different 
ideas about how to support them, 
and they start coding up those 
competing ideas, until one of 
them turns out to be the better 
way. Virtualization is one of 
those areas. Running other OSes 
under Linux used to be “virtually’ 
impossible, or else there were 
frustrating partial solutions that 
tried to emulate a particular OS 
under Linux, with varying degrees 
of success. But, now there are 
things like Xen and KVM, so 
running another OS under Linux 
is trivial. As these projects 
continue to grow, however, their 
incompatibilities tend to stand out 
against each other. Some kernels 
run better under Xen than KVM, 
and vice versa. So, when Stefano 
Stabellini recently announced a 
port of Xen to the Cortez-A15 
ARM processor, the resulting 
technical discussion on the 
mailing list tended to focus a bit 
on getting Xen and KVM to play 
nicely together. 

Another area where multiple 
visions have been realized in the 


t 
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official kernel tree is with display 
drivers. Between OMAP, DRM and 
framebuffer projects, no one can 
agree on which code base should 
be used to provide a more general 
display infrastructure that the 
others could be built on top of. 
Apparently, there’s plenty of bad 
blood to go around, and all the 
projects think that they are the 
most natural choice for the job. 

Recently, the topic came up again 
when Tomi Valkeinen, author of 
the OMAP display driver, suggested 
using OMAP as the framework for 
all display drivers. Of course, the 
DRM and framebuffer folks thought 
that would be a bad idea, anda 
full-throated debate ensued. 

Ultimately, through some 
mediation by Alan Cox, the 
decision seems to have been made 
just to focus on making all three 
of those systems more and more 
compatible with each other. This is 
a clever idea, because it’s hard to 
argue against greater compatibility. 
While at the same time, as the 
different implementations become 
more similar, it should become 
clearer and clearer which one truly 
would be the better choice to 
provide an underlying infrastructure 
for the others.—zack BRowN 
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TikI Me, Elmo 


Somewhere 
between the world 
of SMS messages 
and voice calling 
is the land of 
two-way push-to- 
talk technology. 
Some cell-phone 
providers have 
this feature as an 
option for select phones, which makes your 
2012-era cell phone act like a CB radio from 
the 1970s. Don’t get me wrong, | understand 
there are situations when this is beneficial, 
but it still makes me laugh to see people 
using smartphones like walkie-talkies. 

If you don't have the push-to-talk (PTT) 
feature from your cell-phone provider, you 
can download the free Tikl app from the 
Android Marketplace. Tikl allows you to use 
PTT technology with any other users that have 
Tikl installed on their phones. Because Tikl is 
available for both Android and iOS, it covers 
a wide variety of smartphones. 

| don’t use Tikl very often, but in my limited 
testing at a softball game, it worked as 
advertised. My daughter was able to give me 
her 10-20, and | was able to give her a big 
10-4 on her request to play on the swings. 
Although using Tik!l while driving probably is 
safer than texting, we still don’t recommend 
it. It'd be tough to convince the Smokey 
that your Android smartphone is really a CB 
radiO.—SHAWN POWERS 
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Flying is learning 
how to throw 
yourself at the 
ground and miss. 


—Douglas Adams 


Everyone has a 
photographic 
memory, some just 
don't have film. 
—Steven Wright 


Duct tape is like 
the force. It has a 
light side, a dark 
side, and it holds 
the world together. 
—Unknown (possibly Oprah Winfrey) 


To err is human... 
to really foul 

up requires the 
root password. 


—Unknown 


Real men don’t 
use backups, they 
post their stuff 
on a public ftp 
server and let the 
rest of the world 
make copies. 


—Linus Torvalds 
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New Linux Journal Annual 
Archives for E-Readers 


JANUARY-DECEMBER 2011 ISSUES 


As this issue suggests, 
mobile technology is 
more a part of our 
lives than ever, and 
we are becoming 
accustomed to having 
a tremendous amount 
of information 
available to us at all 
times, frequently on gadgets we keep in 
our pockets and bags. | am also a person 
who likes to keep a lot of documents, books 
and other reference materials on my phone, 
NOOK or tablet. You never know when you 
might need to look something up, right? 

In order to make our articles even more 
available to you, we are introducing an 


JOURNAL 


Issues 201-212 
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annual eBook of Linux Journal content in 
epub and mobi formats. | am a huge fan 
of these formats. In addition to the many 
benefits of reflowing text, | also enjoy the 
ability to search, highlight and take notes 
using my e-reader software. This new 
compilation of all 12 issues from 2011, is 
organized much like our popular Archive 
DVD and contains all of the articles from 
2011 in one easily navigable file. This 
should be exciting to our readers who 
are fans of these e-reader formats, as it 
includes earlier issues that previously were 
not available for e-readers. 

Please visit http://www.linuxjournal.com/ 
ebook for all the information. 


—KATHERINE DRUCKMAN 


Non-Linux FOSS 


If you want to record your Windows screen, but don’t want to an 
fork out the money for a commercial application like Camtasia, 
you might want to give CamStudio a try. CamStudio is an 


23 camstudio Seas 
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OPEN SOURCE 


open-source program that captures your Windows desktop 
and encodes the video using an open-source video codec. 

CamStudio has many features, including picture-in-picture Ready 
support for folks with Webcams. If you're using Windows 
on one of your computers and want to try out some open-source screen capturing, 
give CamStudio a try. Download it at http://www.camstudio.org or from SourceForge 
at http://www.sourceforge.net/projects/camstudio.—sHAwN POWERS 
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GSL, Part II: Getting Work Done 


My last article introduced the GNU 
Scientific Library and how to include it 
in your code, but | didn’t really cover 
what you actually can do with this 
library. Here, | describe some of the 
available functionality, which hopefully 
will spark your interest in taking a 
deeper look. 

A series of functions exist for handling 
polynomials. A polynomial is a function 
of different powers of a variable, with 
each element multiplied by a constant— 
for example: 

P(x) = c{O] + c[1]*x + c[2]*x? + ... 

In the GSL, a polynomial is represented 
by an array containing all of the constants, 
with zeros for all of the missing powers. 
So, if your polynomial is P(x) = 5 + x3, 
your polynomial would be represented 
by c = [5,0,0,1]. Several functions 
are available for evaluating your 
polynomial at some particular value of 
x. And, there are separate functions for 
evaluating your function for real values 
of x (gsl_poly_eval), complex values of 
xX(gsl_poly_complex_eval) and complex 
values of x with complex coefficients 
(gsl_complex_poly_complex_eval). 
This is because complex numbers are 
separate data types (gsl_complex) 
and need to be handled differently 
from simple doubles. 

Aside from evaluating polynomials, you 
may want to solve the polynomial 
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and get the roots of your equation. The 
most basic example is finding the roots 
of a quadratic equation. These roots 

may be real or complex, which means 
there are two different functions: 
gsl_poly_solve quadratic and 
gsl_poly_complex_solve_ quadratic. 
You hand in the values for the three 
coefficients and pointers to two variables 
to hold the two possible roots: 


gsl_poly_solve _quadratic(double a, double b, 


double c, double *x@, double *x1) 


If there are no real roots, xO and x1 
are unchanged. Otherwise, the roots are 
placed successively into xO, and then 
x1. There are equivalent functions to 
find the roots of a quadratic equation 
called gsl_poly_solve_ cubic and 
gsl_poly_ solve _complex_cubic. 

Once you get beyond a quadratic 
equation, there is no analytical way to find 
the roots of a polynomial equation. The 
GSL provides an iterative method to find 
the approximate locations of the roots of 
a higher order polynomial. But, you need 
to set up some scratch memory that can 
be used for this purpose. For a polynomial 
with n coefficients, you would use 
gsl_poly_complex_workspace_alloc(n) 
to create this scratch space. Then, you 
can call gsl_poly_complex_solve 
to run this process. After you are 


done, you would need to call 
gsl_poly_complex_workspace_free 
to free up this scratch space. 

In science, lots of special functions are 
used in solving problems, and the GSL 
has support for dozens of functions. To 
use them, start by including gsl_sf.h 
in your source code. These functions 
can be called in two different ways. You 
can call them directly and simply get the 
computed value as a result. So, if you 
wanted to calculate the value of a Bessel 
function, you could use this: 


double ans = gsl_sf_bessel_JO(x); 


But, you will have no idea if there were 
any problems during this computation. 
To get that information, you would call a 
variant of this function: 


gsl_sf_result result; 


int status = gsl_sf_bessel_ JO e(x, &result); 


The value of status lets you know 
if there were any error conditions, 
like overflow, underflow or loss of 
precision. lf there were no errors, the 
function call returns GSL_ SUCCESS. The 
result variable is actually a struct, with 
members val (the computed value of the 
function) and err (an estimate of the 
absolute error in val). All of the special 
functions default to evaluating with 
double precision, but in some cases, this 
is simply too costly time-wise. In order to 
save time in cases where a lower level of 
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accuracy is acceptable, the GSL special 
functions can accept a mode argument: 


M GSL_PREC_DOUBLE — double 
precision, accuracy of 2*10°'°. 


M GSL_PREC_SINGLE — single 
precision, accuracy of 10°’. 


M GSL_PREC_APPROX — approximate 
values, accuracy of 5*10-4. 


Some of the special functions supported 
by the GSL include Airy functions, Bessel 
functions, Debye functions, elliptic 
integrals, exponential functions, 
Fermi-Dirac functions, Legendre 
functions, spherical harmonics and 
many more. It’s definitely worth taking 
a look at the manual before you even 
think about writing your own version 
of some function, because it’s very 
likely already been done for you. 

Vectors and matrices are used as data 
types in several scientific problems. The 
GSL has support for doing calculations 
with both vectors and matrices, treating 
them as new data types. They are both 
based on a data type called a block. A GSL 
block is a struct containing the size of the 
block, along with a pointer to the memory 
location where the block is actually 
stored. A vector is a struct defined as: 


typedef struct { 
SIZE-t- Size: /* number of elements in the vector */ 


size_t stride; /* step size from one element to the next */ 
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double *data; /* location of the first element */ 
gsl_block *block; /* location of block if data 

is stored in a block */ 
int owner; /* do I own this block */ 


} gsl_vector; 


If owner equals 1, the associated 
block is freed when the vector is freed. 
Otherwise, the associated block is left 
alone when the vector is freed. Because 
of the complexity of the structure, there 
are special functions to handle vectors. 
The function gsl_vector_alloc(n) 
creates a vector of size n, with the 
data stored in the block member and 
the owner flag set to 1. The function 
gsl_vector_free() frees the 
previously created vector structure. 

To manipulate individual elements of 
your new vector, you need to use the 
functions gsl_vector_get(const 
gsl_vector *v, size_t i) and 
gsl_vector_set(gsl_vector *v, 
size_t i, double x). If you instead 
want a pointer to an element, you can use 
£51 vector _ptr(gsl_vector *v, 
size_t i). Matrices are very similar, 
being defined as: 


typedef struct { 
size_t sizel; /* number of rows */ 
size_t size2; /* number of columns */ 
size_t tda; /* number of bytes for one row */ 
double *data; /* location of matrix data */ 
gsl_block *block; /* underlying storage block */ 
int owner; /* do I own this block */ 


} gsl_matrix; 
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Matrices are stored in row-major 
order, which is the way it is done in C. 
Allocation and deallocation are handled 
by the functions gsl_matrix_alloc() 
and gsl_matrix_free(). Accessing 
elements are handled through the 
functions gsl_matrix_get() and 
gsl_matrix_set(). 

Now that you have vectors and 
matrices, what can you do with them? 
The GSL has support for the BLAS library 
(Basic Linear Algebra Subprograms). 
There is a wrapped version, accessible 
through gsl_blas.h, where you can 
use GSL vectors and matrices in the 
functions. You also have access to the 
raw BLAS functions through the include 
file gsl_cblas.h. The GSL version treats 
all matrices as dense matrices, so if you 
want to use band-format or packed- 
format matrices, you need to use the 
raw functions. There are three levels of 
BLAS operations: 


@ Level 1: vector operations. 
@ Level 2: matrix-vector operations. 
M@ Level 3: matrix-matrix operations. 


BLAS has functions for things 
like dot products, vector sums 
and cross products. This provides 
the base for the linear algebra 
functions in the GSL. They are 
declared in the header gsl_linalg.h 
and are handled through level-1 


and level-2 BLAS calls. There are 
functions for decomposition (LU, QR, 
singular value, Cholesky, tridiagonal 
and Hessenberg), Householder 
transformations and balancing. The 
header file gsl_eigen.h provides 
functions for calculating eigenvalues 
and eigenvectors of matrices. There 
are versions for real symmetric, real 
nonsymmetric, complex hermitian 
and real generalized nonsymmetric 
eigensystems, among others. 

The last thing to look at is the 
functionality supporting calculus 
calculations. A whole group of 
functions handles numerical 
integration, and there are routines 
for both adaptive and non-adaptive 
integration for general functions. 
There also are specialized versions 
for special cases like infinite ranges, 
singular integrals and oscillatory 
integrals. The types of errors that may 
happen when you are trying to do a 
numerical integration are: 


M GSL_EMAXITER — the maximum 
number of subdivisions was exceeded. 


M GSL_EROUND — cannot reach 
tolerance because of round-off error. 


M GSL_ESING — a non-integrable 
singularity or bad integrand behavior. 


M GSL_EDIVERGE — integral is 
divergent or doesn’t converge 
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quickly enough. 


Numerical differentiation also can 
be done, using finite differencing. 
These functions are adaptive, trying 
to find the most accurate result. The 
three versions are: 


M gsl_deriv_central() — central 
difference algorithm. 


M gsl_deriv_forward() — adaptive 
forward difference algorithm. 


M gsl_deriv_backward() — 
adaptive backward difference 
algorithm. 


In all of these, you hand in a pointer 
to a function, the value of x where you 
want to calculate the derivative and 
a step-size, h, for the algorithm. You 
also hand in pointers to variables to 
store the values of the result and the 
absolute error. 

| have barely scratched the surface 
of what is available in the GSL. 
Hopefully, you now have a better idea 
of some of the functions available. 
Although lots of scientific packages 
are available, sometimes there really 
is no option except writing your own. 
With the GSL, you should be able to 
do this with a bit less work and get 
to the actual computational science 
more quickly. 

—JOEY BERNARD 
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Cryptocurrency: Your 
Total Cost Is 01001010010 


Most people 
have heard of 
gold. Most 
people are 
familiar with 
dollars. For 

a handful of 
geeky folks, 

however, the 
currency they 
hope will become a global standard 
is digital. Whether it’s a problem 
or not, the currency you use on 
a day-to-day basis is tied to the 
government. The global value of 
the money in your pocket can vary 
widely, and if you're a conspiracy 
theorist, your concern might be that 
it could be worth nothing in the 
blink of an eye. 

Surely gold and silver are wise 
investments if you're concerned 
your paper dollars will drop in value, 
but using gold as a means to buy 
a gallon of milk is a bit difficult. 
Perhaps cryptocurrencies are the 
solution. The most popular form of 
cryptocurrency is the Bitcoin. A very 
simple explanation of how it works 
is as follows: 


® Users download the bitcoin client 
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and use their computer to solve 
complex math problems, which 
create a cryptographic record of 
any transactions on the Bitcoin 
P2P network. 


M Users are rewarded Bitcoins 
for successfully “hashing” 
the cryptographic record of 
transactions, and that reward 
system is how Bitcoins are 
created. 


M Users then securely transfer 
Bitcoins back and forth to 
purchase items, and those 
transactions are recorded in the 
cryptographic history for the 
entire P2P network to see. 


The process is, of course, a little 
more complicated than that, but 
that’s basically how it works. The 
computers creating the cryptographic 
history of transactions are called 
miners, and “Bitcoin Mining” is 
simply the act of solving complex 
math problems in order to make a 
cryptographic record of transactions. 
Because mining Bitcoins is how the 
currency is created, lots of people 
are connected to the network, racing 
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each other to get a solution that will gold, but many think that day is 
generate a reward. In fact, it’s so coming. What about you? Do you 
competitive, that unless you have a think cryptocurrency has a future, 
high-end GPU that can process the or do you think it’s a geeky fad that 
equations extremely fast, there is no will fade away? Send an e-mail with 
point in trying for the rewards. “CRYPTOCURRENCY™” in the subject 
Are Bitcoins the future of line to shawn@linuxjournal.com, 
global currencies? Will one of and I'll follow up with a Web article 
the alternative cryptocurrencies based on your feedback. For more 
like Litecoin or Solidcoin become information on cryptocurrencies, 
commonplace? The number of places check out these Web sites: 
that accept cryptocurrencies are http://www.bitcoin.org, 
extremely limited, so it’s not any http://www.litecoin.org and 
easier to buy a gallon of milk with http://www.solidcoin.org. 
a Bitcoin than it is with a lump of —SHAWN POWERS 
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Calibre in the Cloud 


I've mentioned before that | keep my 
entire e-book collection in my Dropbox 
folder, and | can access it anywhere | have 
a Web connection. | didn’t come up with 
the idea myself; instead, | shamelessly 
stole the idea from Bill Childers. | suspect 
he stole it from someone else, so feel free 
to steal the idea from me. 

Basically, it involves two programs, 
both free (well, three, if you count 
Dropbox). First, create a folder inside 
your Public folder that resides in your 
Dropbox 


Public Dropbox folder. Calibre will move 
your entire library to that folder, so make 
sure you have enough free space in your 
Dropbox to handle your entire e-book 
collection. If you have too many e-books, 
you could create a separate library inside 
Calibre and just keep a select few books 
in that Public folder. 

Now you should have a working install 
of Calibre that stores your e-books and 
database inside your Dropbox. You simply 
can open this library file with Calibre on 


folder. You 

can name this 
folder anything 
you like, but 
because it will 
be hosting all 


File Profiles Tools Help 


ci wi 


calibre2opds 2.4 (rev. 259) — 


me ES 850 ee 


Default mode: the catalog is created in the same folder as the Calibre database and other files 


Main options | Catalog generation options | Advanced customization options | External links 


your e-books, it’s 
wise to name 


Language jen v 


Database folder |fhome/spowers/Dropbox/Public/my_ebooks _ 


it something 
no one 
would guess. 
Then, in 
Calibre, click on 
the bookshelf 
icon (upper 
left), and click 
“switch library”. 
Then, select 
that new secret 
folder you made 
inside your 


Destination folder [ 


Copy catalog to database folder |v| 


Reprocess the epub metadata [ | 


Catalog folder [catalog 


Catalog title (Calibre library 


Split tags using |v] Disable splitting tags 


Tag that will specify a book language Lang: 


List of tags that will generate a catalog | 


List of tags that will be excluded from the catalog | 


Wikipedia language jen 
OPDS 


Compatibility level 


OPDS" 
TROOK 
STANZA 


Click on a labq 


led description 


ALDIKO 


Exit Reset to defa 


Generate catalogs 


Figure 1. calibre2opds is a GUI Java application. 
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==] + Catalog Folder 
to something. It’s 


@ 


{} di.dropbox.com 


+ | (al okay to leave it 


a) @ 


Shawn's eBook Collection 


Catalog generated on Sep 25, 2011 


Main catalog Recent additions 


Jonathan Strahan 


10/08 - Ghost Story 
Jim Butcher 


21/08 - The Best Science Fiction & Fantasy of the Year Volume 5 


21/08 - Realms 1: The First Year of Clarkesworld Magazine 

Jeff VanderMeer & Elizabeth Bear & Catherynne Valente & Caitlin Kiernan & Jay Lake & Sarah Monette 
& Lavie Tidhar & Ian Watson & Vylar Kaftan & Jenny Davidson & Erica Satifka & Sharon Mock & Barth 
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set to _catalog, 
which is the 
default. 

Next, you 
need to decide 
what sort of 
Web site you 
want to create. 
If you want to be 
able to browse 
it with any Web 
browser, leave the 
“Compatibility 
Level” at “OPDS”. 
If you want to 


Figure 2. Here is my e-book collection, created by calibre2opds. 


other computers that sync with Dropbox, 
or you can go one step further and create 
a cloud-based repository that you can 
browse from any computer. And, that’s 
where calibre2opds comes into play. 
calibre2opds is a Java application that 
creates a Web site from your Calibre 
library. Download the Java application 
from http://www.calibre2opds.com, 
and launch it with your favorite Java 
runtime environment. Once it’s launched, 
you'll see many options for tweaking 
how your library will look. The first 
thing you need to do is make sure the 
Database Folder is pointed to the secret 
folder to which you moved your Calibre 
library. Then, you'll want to set the 


browse directly 
with your Android 
device, you can 
choose either TROOK or ALDIKO, and 
calibre2opds will generate a catalog that 
those readers can access directly. Once 
you tweak any other settings to your 
liking, click the Generate Catalogs button 
on the bottom, and it will create all the 
files you need right inside your Calibre 
database folder. 

Because you did all this inside your 
Public Dropbox folder, you can look 
for that _catalog folder and find the 
index.html file inside it. Right-click on 
index.html, get the Dropbox public link 
for it, and see the result. (Note: you may 
need to find the index.xml file if you're 
trying to browse with Aldiko or Trook.) 
—SHAWN POWERS 
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Logging 


REUVEN M. 
LERNER 


Knowing how to read logs and write to them are important 


skills for all Web developers. 


When you’re writing programs that 
operate on the command line, the 
error messages either appear in the 
same place as you're typing (that is, 
in the same terminal window) or are 
sent to a back-end logging system, 
such as the venerable “syslog” facility 
that Linux provides. But, one of the 
surprises and frustrations that Web 
developers encounter is that there is 
no such thing as a “terminal” in which 
their Web application is running. 
Rather, the Web server sends its error 
messages somewhere else entirely, to 
one or more files. 

| often tell participants in my Web 
development courses that they should 
embrace their new best friend, the 
logfile. And, indeed, logfiles are a 
priceless tool in the hands of a developer, 
making it possible—like a doctor—to 
understand the source of a problem 
and then diagnose and fix it. Because 
there is no way to interact directly with 
a Web server, looking at the effects as 
displayed in the logfile is the best way to 
understand what is happening. Through 
the years, I’ve learned, however, that 
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developers often are unfamiliar with 
many of the issues having to do with 
logging and how they can make the best 
use of those logs to ensure that their 
programs run as smoothly as possible. 
So in this article, | look at a number 
of issues having to do with logging, as 
well as some strategies and techniques 
you can use to make best use of the 
logs. Some of the things | mention 
here are specific to the Ruby on Rails 
framework, which | use in much of my 
day-to-day work, but several techniques 
are common to many packages or to 
programming in general. 


Where Are You Logging? 

A typical modern Web application 
consists of a database server, an HTTP 
server and an application. For example, 

| generally use PostgreSQL (database), 
Apache (HTTP) and Ruby on Rails 
(application), but it’s not unusual for me 
to use other technologies, from MySQL 
and MongoDB to other languages, 
servers and systems. Each program has its 
own logfile, with its own configuration 
settings and output syntax. 
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The first thing you should do when 
working on a project, whether you are 
starting it or taking it over from someone 
else, is determine which logfiles are 
being written to. In a Web application 
that uses Apache, Rails and PostgreSQL, 
you'll have at least three different 
logfiles, one for each of these programs. 

Sometimes these logfiles are placed 
under the /var/log directory in your 
filesystem, but not always. It’s not 
unusual for a PostgreSQL logfile to be 
in the “data directory”, which on my 
systems often is in /usr/local/pgsql/data. 
Note that the default location for a 
program's logfiles might not match the 
location that your Linux distribution 
has adopted, so unless you're careful, 
you can end up with two separate 
logfile directories, one of which is 
ignored by the system. 

Some programs can create more than 
one logfile. Apache is able to act as an 
HTTP server for multiple sites, and it’s 
often helpful to be able to separate 
out logs for those sites. And, Apache 
also separates HTTP request logs from 
errors and referrers, meaning that if 
you want to understand fully what 
is happening on your site, you might 
need to piece together several logs just 
for the HTTP server. 


Apache Logs 

The two most important logs that Apache 
produces are the request log and the 
error log. A typical line in the request 
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log (using the “common format”, 
which combines referrer information 
with requests) represents a single HTTP 
transaction and looks like this: 
84.108.219.125 - - [09/Jan/2012:14:13:52 +0200] 

"GET / HTTP/1.1" 200 764 "http://lLinuxjournal.com/" 
"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6 8) AppleWebKit/535.11 


> (KHTML, Like Gecko) Chrome/17.0.963.26 Safari/535.11" 


The most important elements of this 
entry are as follows: 


M The request was made from IP 
address 84.108.219.125. 


M The request took place at 14:13:52, 
UTC + 2. 


M The GET method was used to request 
/, using HTTP 1.1. 


M@ The return code was 200. 
M The response contained 764 bytes. 


M The user came to this page from a link 
at LinuxJournal.com. 


M The user was browsing with the Safari 
browser, on an Intel-based Mac. 


The access log can be useful for a 
number of reasons. First, I’m often 
trying to debug the HTTP requests that a 
program makes to a server. This can be as 
mundane as when | click on a link in my 
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The test logfile generally is full of enough detail 
that if something goes wrong, you can reproduce 
it in the console and understand why it didn’t work. 


browser or when I’m writing a program 
that is trying to retrieve information 
from a server. The HTTP access log shows 
me precisely what URL was sent to the 
server; | frequently have been able to 
debug problems with the requesting 
program as a result. 

Of course, only GET requests, in which 
name-value pairs are part of the URL, are 
debugged easily in the access log. POST 
requests send their name-value pairs on a 
separate channel, which means you can’t 
rely on the server log to display them. 

It's also easy to assemble basic 
Statistics about a site by looking at the 
Apache logs. For example, from my 
server, the response code is column 
#9 of the logfile. By chaining together 
several command-line tools, | can find 
out what percentage of each request 
got each response: 
cut --flelds=9 --delimiter=' ' access.log | sort | uniq -c 

First, | use cut to divide the logfile 
into fields, separated by spaces. Next, | 
grab the 9th column, which corresponds 
to the HTTP response code. | then sort 
those codes and use unig to count the 
number of times each one appears. 

The other important Apache logfile, 
and one that Is crucial in debugging 
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Web applications, is the error log. 

Not only does this file mention many 
errors and warnings that Apache has 
encountered, but also anything that 

the Web application might have sent to 
the STDERR filehandle while executing. 

If something goes wrong on a Web 
application that I’m developing, my first 
instinct is to look at the error log. Often 
messages there will give me an indication 
of what is happening, including warnings 
of errors, incorrect HTTP headers or 
truncated requests. 


Application Logs 

For many years, the Apache error log 
was the best tool | had for debugging 
Web applications. Modern Web 
frameworks operate outside Apache 
(or any other HTTP server) though and 
often have their own logfiles. Ruby 
on Rails, for example, has a separate 
logfile for each of its environments. 
Thus, under the logs directory, you 
typically will find development.log, 
production.log and test.log. 

The test environment is where you 
run your tests, and having a full-fledged 
logfile that | can open and peruse after 
tests have failed makes it relatively easy 
to figure out why they didn’t work. The 
test logfile generally is full of enough 
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detail that if something goes wrong, 
you can reproduce it in the console and 
understand why it didn’t work. 

The development log also is full of 
useful information. Although it reflects 
whatever requests you make to the 
development server, it offers a chance for 
more insight. For example, the default 
setting in Ruby on Rails gives a huge 
amount of information about database 
access via ActiveRecord, including the 
SQL that ultimately is sent to the server 
and when objects are fetched from 
ActiveRecord’s cache, rather than from 
the database itself. When I’m developing 
a Web app, it’s very common for me to 
doatail -f (more on that below) on 
the Web application log. 

The production log, as its name 
implies, is written to the production 
server. On systems with more than one 
production server, it can become tricky 
to keep track of multiple logs, because 
you cannot know to which production 
server given users will be sending their 
HTTP requests. In such instances, using 
a system that allows you to aggregate 
logs in a single place, such as syslog or 
Graylog2 (which | haven't ever used, 
but it looks like a marvelous system), 
might well come in handy. When | 
have a small number of servers, | often 
take the easy way out, putting the 
production logs separately on each 
server and then just looking at both via 
tail -f to see where a problem might 
have cropped up. 
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Database Logs 

Most modern Web applications use a 
database of some sort. These often 

are relational databases, such as 
MySQL and PostgreSQL. Each of these 
databases has a variety of switches and 
configuration variables that you can 
set to describe and customize the ways 
in which logfiles are written. 

| tend to use PostgreSQL whenever 
possible and generally set up the logs 
the same way on all systems | run. | 
turn logging on and configure the logs 
to rotate once per day, such that | have 
the last seven days’ worth of logs if | 
ever need to check on something. 

One of the nicest things about 
PostgreSQL’s logs is that you can decide 
what you want to log—connections, 
disconnections, query parse trees, 
statement durations, vacuum execution 
or even the output from the query 
optimizer. These settings are in 
the postgresql.conf configuration 
file, which normally sits in the data 
directory, alongside the security 
configuration file pg_hba.conf. 

By setting the appropriate variables 
in postgresql.conf, you can set separate 
log levels for client connections 
(client_min_messages) and the logfile 
(log_min_messages), such that the 
logfile contains more detail than 
messages sent to database clients. You 
can ask for log messages to be displayed 
verbosely (log_error_verbosity), which 
gives a level of detail I’ve never 
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found useful, but which undoubtedly 
comes in handy when doing low-level 
database hacking. 

The log_statement parameter allows 
you to log DDL (database definition 
statements), mod (modifications to the 
database) or everything. 

One of the most useful log-related 
settings in the PostgreSQL configuration 
file is log_min_duration_statement. By 
default, it is set to -1, meaning that it 
is deactivated. Given a positive number 
as a parameter, this will log any time 
a statement on your PostgreSQL server 
takes longer than a certain number 
of milliseconds. | normally set this to 
100ms and then can go through the 
logfile (using grep, searching for the 
word “duration”) to find which queries 
are taking the longest. That allows 
me to concentrate my efforts on the 
slowest queries, as identified by the 
database server itself. 


How to Read Logs 
One of the best ways to read through 
logfiles is also the easiest, namely the 
less command. less, which is a 
modern replacement for the traditional 
UNIX more command, lets you page 
through a file, backward and forward— 
and if the file grows while you're 
viewing it, Less still will let you read 
through it, including to the current end 
of the file. 

less has a very large number of 
options that you can apply. For years, 
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my .zshrc profile has defined the PAGER 
environment variable to be: 


Less -RXs 


This means it shows raw control 
characters (useful for reading colorized 
logs and man pages), that it doesn’t 
reset the terminal (which | admit | 

use out of habit, rather than having 
demonstrated with certainty that this 
option is necessary), and that multiple 
blank lines will be squeezed into a 
second one. The fact that searching 

in Less not only supports regular 
expressions, but also highlights any text 
that matches my search, makes it fairly 
easy to find my way around. 

However, | often want to read the 
logs as they come through. One easy 
way to do this is with tail -f. The 
tail command shows you the final 
lines of a file on your filesystem. The 
-f flag tells Linux to keep reading 
from the file as it grows and to 
print it on the screen. When I’m 
developing, | often have one terminal 
window open on the application's 
logfile with tail -f: 


tail -f log/production.log 


If you're on a heavily loaded server, 
the output from tail -f not only will 
slow down your machine, but also will 
be unreadable by you. The solution is to 
filter the output of tail -f through 
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grep, looking for a particular piece 
of text that is of interest to you, such 
as the name of a variable, function or 
error message. 

If you want to grab a bunch of 
lines, you can use grep’s -A (after), 
-B (before) or -C (context = before + 
after) flags. For example, if you want 
to see the list of parameters sent to 
your Web application server every time 
the Home#index method is called, you 
can do this: 


tail -f log/production.log | grep -A10 Home#index 


Do you really need ten lines after 
the method name is printed in the 
logs? Probably not, but this ensures 
that you'll get all of the parameters, 
without having to read through lots of 
other stuff. 


Writing to Logs 

It might sound odd, but it takes 

some practice to learn how to write 

to logfiles as well. | tend to write a 

lot of information to logs when I’m 
developing a Web application. | realize 
there are people for whom a debugger 
is their first tool of choice, but mine 

is the console that Rails provides, 
followed closely behind by the 
logfiles. From a Rails application, you 
can write to the log at any point using 
the “logger” object, which is defined 
in all models and controllers. The 
logger object supports a method for 
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each log level, from “crit” (critical) to 
“info”, and everywhere in between. 
So to write “hello” into the logs, you 
would write: 


logger.warn "hello" 


Now, whatever you write to the logs 
is printed verbatim. You can, of course, 
write the value of a variable: 


logger.warn some variable 


But, this is almost always a bad way 
to go. First, you want to be able to 
find what you've written to the logfile. 
Second, you're probably going to be 
writing multiple variable values, so 
you will want to indicate what you're 
printing here to distinguish it from 
other places. And finally, if the variable 
value is blank, or a newline, you'll 
want to know that—most easily by 
putting its value between delimiters. 
So when | want to print a variable 
value, | do something like this: 


logger.warn "[ObjectName#method_name] some_variable 


== '#{some_variable}'" 


Now | easily can find this value in the 
logfile; | can know in which method | was 
printing things, and | also can distinguish 
between different values—an empty 
string, a space or a newline. 

If it's a complicated variable, | sometimes 
use the built-in to_json or to_yaml 
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methods that Rails provides: 


logger.warn "[ObjectName#method_name] some_variable = 


=» '#{some_variable.to_yaml}'" 


But watch out! I’ve learned the hard 
way that certain objects cannot be 
printed to YAML. What happens in those 
cases is that you get an error message 
instead of a printout, and that can cause 
more head-scratching, trying to figure 
out how and where you introduced a 
new bug. Printing things simply, in 
non-YAML format, is generally a good 
idea, when you can get away with it. 


Logging Every Action 

On some projects, | go all-out, logging 
every HTTP request to the database. This 
is a tremendous help when debugging 
applications, although it does tend to 
have the side effect of slowing things 
down, because each request needs to 
write to the database. (Using a non- 
relational database probably would be a 
faster way to go about this, although | 
enjoy using the powerful queries that SQL 
provides when | need to pull information 
out.) When | do this, | typically create a 
logged_actions table in the database, 
containing the following columns: 


M@ user_id. 
BH controller name. 


HM action name. 
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M logged_at (timestamp). 


M message (allows me to stick an 
arbitrary message into these logs). 


M ip_address (of the person requesting). 
M browser_info (from the user's browser). 
M@ URL. 


HM params (all of the parameters sent, 
via GET and POST). 


M session (the user’s entire session, 
written in YAML if possible). 


M cookies (the user’s cookies, written in 
YAML if possible). 


M flash (contents of the Rails “flash”, 
a sort of temporary session). 


M@ referrer. 


| then create a “before filter” in the 
application controller, such that every 
single request to the Web application 
results in an entry in the Logged_Actions 
table. Moreover, whenever | want to add 
some debugging or other information, | 
put it into the logs in the usual way, or | 
can write it with much more information 
and context via my Logged_Actions 
table. This table, and the entries in it, 
have proved to be extremely valuable 
in many cases, allowing me to debug 
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problems that otherwise would have 
been difficult to revisit or understand. 
When I’m not debugging, | often turn 
this feature off, given the combination 
of overhead that it causes and the 
potential privacy/security issues that 
it can sometimes raise. In some cases, 
I've configured this before filter based 
on a configuration parameter that | set 
elsewhere in the system, such that | can 
turn fine-grained logging on and off 
without having to modify and re-deploy 
the application. 


Conclusion 

If you are a Web developer, and if you 
aren't yet using logfiles as part of your 
development and debugging process, 

| strongly suggest you begin to do so. 
Logfiles are a gold mine of information 
in all cases, but when you start to track 
and write additional messages, you give 
yourself the ability to discover and fix 
problems even before your users are 
aware of them happening. Plus, if you 
keep track of users’ parameters and 
request information, you can often 
discover, as | have, that sometimes the 
problem has to do with something in 
users’ sessions or histories, or even the 
browsers they are using to visit your site. ml 


Reuven M. Lerner is a longtime Web developer, architect 
and trainer. He is a PhD candidate in learning sciences 

at Northwestern University, researching the design and 
analysis of collaborative on-line communities. Reuven lives 
with his wife and three children in Modi‘in, Israel. 
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Resources 


Logging is a broad topic, but one of the 
best treatments and discussions I’ve 
recently encountered was on the Ruby 
Rogues podcast. Episode 25 was about 
logging and had an in-depth discussion of 
what to log, how to log and various tools 
that have to do with logging. 


Apache has a very flexible logging system. 
If you are running the latest (2.2) version of 
Apache HTTPD, read the documentation at 
http://httpd.apache.org/docs/2.2/logs.html. 


The Graylog2 Project, although | haven’t used 
it myself, looks like a great way to both store 
large volumes of logging information, and then 
produce reports and analysis based on it. It’s 
worth looking into, at http://graylog2.org. 


A highly sophisticated and mature logging 
system for Java, known as Log4j, is run 

by the Apache Software Foundation at 
http://logging.apache.org/log4j. There are 
versions of log4j in many other languages, 
including Python, Ruby and Perl, giving you 
the ability to write different types of levels 
of messages to different destinations. 


Finally, you can read more about 
PostgreSQL’s logging capabilities in the 
documentation. Look for “Error Reporting 
and Logging” in the manual, which is 
always available at http://postgresql.org. 
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WORK THE SHELL , 


A Word Finder 
for Words 
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DAVE TAYLOR 


With Friends 


Dave continues to explore how to create a Scrabble suggestion 
engine and learns that regular expressions sometimes aren’t 


the best path to a solution. 


In my last article, | looked at a simple 
crossword-puzzle word finder, something 
that requires a word list and a basic 
understanding of grep. Then, | switched 
to looking at Scrabble and the popular 
on-line equivalent Words With Friends. 
In this latter case, the problem turns 
out to be quite a bit more difficult. Say 
you have seven tiles (one or more of 
which could be a blank or wild-card 
tile, but I'll address that later) that are 
a random set of letters, and from that, 
you want to combine them to create 
dictionary words. For example, I’m 
playing a game of Words With Friends 
with my sister, and the tiles | have to 
work with are TE C Y ZS X. But, of 
course, any good Scrabble player knows 
that you also need to work with the 
letters already on the board, so although 
| can make a word like “YET” or “SEX” 
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from these letters, | still have to interlock 
the word onto the board somehow. It’s 
harder, but that’s where big-point word 
play comes from. 

Still, let’s stick with the basics: enter a 
set of letters, and the script will offer a set 
of possible words using those letters. What 
about all these nuances? Yeah, they’re 
going to make this way more complicated! 


Words from Your Letters 

Tapping the word list we downloaded in 
the last column, the most obvious search 
is for the letters as a regular expression: 


5 grep **t*e*cty*z*s*x)” words. txt 
ex 


Ah, that doesn’t work well because 
the order of the letters is important to 
grep although it’s not important to us. 
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Instead, a complicated pipe offers an 
interesting alternative: 


grep t words.txt | grep e | grep c | grep y 


| grep z | grep s | grep x 


But, that doesn’t produce any results 
because it’s looking for words that 
have all the letters in our hand, and 
that’s basically impossible. 

So, what about this: 
grep 't*' words.txt | grep 'e*' 


| grep 'c*' | grep 'y*' 


| grep 'z*' | grep 's*' | grep 'x*' 

The x* notation is “zero or more 
occurrences of letter x”, and that is 
clearly not going to work because every 
word matches this complex search 
pattern if you think about it. 

Let’s flip this around and screen out all 
words that contain letters not in our set 


of letters instead: 


$ grep -vE '[4tecyzsx]' words.txt 
cee 
cees 
cess 


There's another problem. The words 
match, except we’re not taking into 
account the frequency of each letter. That 
is, although “cess” indeed comprises only 
letters in our set, we have one “s”, not 


two, so it’s not actually a valid match. 


WORK THE SHELL 


Then again, at least it’s a step in the 
right direction, which is more than the 
previous examples have demonstrated, 
so let’s run with it. 


Analyzing Length and Filtering Results 
With seven letters, the first simple 
secondary filter is that any words longer 
than seven letters can be axed. How 

to test? The wc command works, but 
awkwardly. Still, | have a sense we're 
going to end up with each possible 
match going into a more complex test, 
so let’s start building it: 


#!/bin/sh 
# Findword -- find matching dictionary words for 
Scrabble given a set of letters 
datafile="words. txt" 
maxlength=7 
minlength=4 
if [ -z "$1" ] ; then 

echo "Usage: $(basename $0) letters"; exit 1 
fi 


for possibility in $(grep -vE "[%$1]" words. txt) 


do 
length=$(echo $possibility | wc -c) 
if [ $length -gt $maxlength ] ; then 
echo "$possibility is too long" 
elif [ $length -1t $minlength ] ; then 
echo "$possibility is too short" 
else 
echo $possibility is a possibility -- length = $length 
fi 
done 
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WORK THE SHELL 


You might find it faster simply to add one 

to each of the default settings, but because 
down the road, I am anticipating letting the 
user specify min/max length words, the 
compensatory code seems a better solution. 


There’s a built-in problem with 
this script that you'll realize if you're 
familiar with how wc counts letters. 
To demonstrate: 


$ echo Linux | we -c 
6 


Six? Shouldn't that be five? 
The fix is to add the following: 


# adjust lengths because our fast wc-c adds 1 char 
maxlength=$(( $maxlength + 1 )) 
minlength=$(( $minlength + 1 )) 


You might find it faster simply 
to add one to each of the default 
settings, but because down the 
road, | am anticipating letting the 
user specify min/max length words, 
the compensatory code seems a 
better solution. 

With that added code, we can find 
five-, six- or seven-letter words that 
are made up of only the letters in our 
hand by simply commenting out the 
“too long/too short” message: 
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$ findword.sh tecyzsx 


cees iS a possibility -- length = 5 
cess iS a possibility -- length = 5 
cesse is a possibility -- length = 6 
cesses is a possibility -- length = 7 


cete is a possibility -- Length = 5 
cetes is a possibility -- length = 6 
cyeses is a possibility -- length = 7 


Now, we can’t sidestep any longer; 
it's time to figure out how to test for 
the frequency of each letter to ensure 
that the words actually can be formed 
by the tiles we hold. Note that in the 
above example, none of the above 
words are actually a match when letter 
frequency is taken into account. 


Counting Letter Occurrences 

The first piece of this puzzle is to 
figure out how many times a letter 
occurs in a given word or sequence. 
Although there probably is a regular 
expression to do just that, | settled on 
the -o flag to grep, as demonstrated: 


$ echo test | grep -o t 
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Append awc -1, and you can write a 
simple function that returns the number 
of times a specified letter occurs in a 
given word or sequence: 


occurrences () 

{ 
# how many times does 'letter' occur in 'word'? 
local count=$( echo $2 | grep -o $1 | we -1 ) 


echo $count 


WORK THE SHELL | 


echo occurrences "t" "test" 


occurrences "t" "test" 


Testing will demonstrate that the result 
is “2”, as hoped for. This'Ill be the starting 
point for us in my next article when we 
continue this epic scripting journey into 
the world of Scrabble, Words With Friends 
and other word games.™ 


Dave Taylor has been hacking shell scripts for more than 30 years. 
Really. He’s the author of the popular Wicked Cool Shell Scripts 
and can be found on Twitter as @DaveTaylor and more generally 
at http://www.DaveTaylorOnline.com. 
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HACK AND/ 


Password 


KYLE RANKIN 


Cracking with 
GPUs, Part Ill: 
Tune Your Attack 


You’ve built the hardware, installed the software and cracked 
some passwords. Now find out how to fine-tune your attacks. 


In the first two parts of this series, 

| explained what hardware to get and 
then described how to use the hashcat 
software suite to perform dictionary 
and brute-force attacks. If you have 
been following along, by this point, you 
should have had plenty of time to build 
your own password-cracking hardware 
and experiment with oclhashcat. As | 
mentioned in my last column, password 
cracking Is a pretty dense subject. In this 
article, | finish the series by describing 
how to tune and refine your attacks 
further so they can be more effective. 


Use More GPU Cycles 

The first area where you can fine- 
tune your attacks is to put more or 
less load on your GPU. The -n option, 
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when passed to oclhashcat, changes 
how much of your GPU will be used 
for an attack. The documentation says 
that this value is set to 80 by default; 
however, on my computer, it seemed 
like the default was set closer to 40. 
When | first ran a brute-force attack, 
the output told me | was using around 
70-80% of my GPU. Once | added 

-n 80 to my oclhashcat command, | 
noticed | was using between 96-98% 
of my GPU and had added an extra 
40,000 comparisons per second: 


/path/to/mp32.bin -1 ?d?1l?u ?1?21?21?21?1?1 | \ 
/path/to/oclHashcat-plus32.bin -m 400 -n 80 \ 


-o recovered_hashes phpass-hashes 


Experiment with passing different 
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values to -n, and see whether your 
comparisons per second and the 
percentage of GPU used increases. 
Be careful though; the higher the 
number, the more power your GPU 
is going to use (and if it’s not well- 
cooled, the hotter it will run). Also, if 
you plan to use the system for other 
things while you crack passwords, 
you may notice a greater impact on 
graphics performance. 

Although it may seem like increasing 
the -n setting is a no-brainer, it 
turns out that a higher setting 
really only benefits brute-force 
attacks. The hashcat documentation 
recommends you try lower -n values 
when attempting dictionary attacks. 
Ultimately, the key is to experiment 
with both high and low values and see 
what gives you the best results. 


Mask Attacks 

In Part Il of this series, | described 
two types of attacks: a dictionary 
attack and a brute-force attack. With 
a dictionary attack, you provide the 
cracking software with a dictionary 
full of possible passwords to try, such 
as all of the words in the English 
dictionary. A brute-force attack iterates 
through all possible combinations 

for a password of a certain length. 
Because a dictionary attack generally 
has way fewer passwords to try, it is 
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much faster than a brute-force attack. 
Although a brute-force attack takes a 
long time, it also ultimately will find 
the passwords you are looking for. 

It turns out you aren’t limited by 
either a fast, possibly ineffective, attack 
or a highly effective, but slow, attack. 
With mask attacks, you can combine 
the speed of dictionary attacks with 
some of the thoroughness of a brute- 
force attack. Mask attacks work by 
making some educated guesses about 
the characters that might be used in 
a password. With a mask attack, you 
perform a brute-force attack only with 
a far smaller list of combinations to try 
all based on a pattern. 

Mask attacks make more sense once 
you see an example. Let’s say that you 
are attempting to crack a password, 
and you know the password policy 
requires the user to select at least 
one uppercase letter and at least one 
number. As | mentioned in my previous 
article, you can calculate how many 
combinations are in a particular type 
of password by taking the number 
of characters in the character set, 
figuring out how long the password 
is going to be, then raising the first 
number to the power of the second. 
So, for instance, if you wanted to do 
a thorough brute-force attack against 
the above password policy, you would 
have 62 characters in your character 
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set (A—Za—z0-9) and with an eight- 
character password, the number of 
combinations would be: 62% = 218 
trillion combinations. 

At 350,000 comparisons per second on 
my password-cracking hardware, it would 
take me approximately 7,200 days, or 19 
years, to complete the attack. 

The fact of the matter is, when you 
tell most users to create an eight- 
character password that has at least 
one uppercase character and at least 
one number, most users aren't going 
to generate a truly random password. 
Instead, they likely will make the first 
letter uppercase and then use lowercase 


characters until they get to the end of 
the password, where they either will 
add a single number to the end of the 
password or they will put a four-digit 
year at the end—usually the year they 
were born, the year they graduated 
high school or the current year. A mask 
attack against the same password 
policy would build a brute-force pattern 
where you would just try an uppercase 
letter as the first character, lowercase 
for the next three, then either 
lowercase or numbers for the final four 
characters. In that case, the number of 
combinations would be: (26) * (26?) * 
(364) = ~ 767 billion combinations. 
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On my hardware, that would take a 
bit more than 600 hours, or 25 days. 
Although that’s a long time to crack a 
password, it’s still a lot better than 19 
years and likely will be effective against 
a large number of weaker passwords. 

To describe this pattern, | use the 
same custom pattern language with 
maskprocessor that | used in the 
previous column for regular brute-force 
attacks, only in this case, | combine 
a custom pattern that includes all 
lowercase characters and numbers with 
a regular set of character patterns. The 
final maskprocessor command would 
look like: 


/path/to/mp32.bin -1 ?d?l ?u?1?1?1?2121?1?1 


As you can see, | defined a special 
mask of ?d?1 (0O-9a-z) and assigned 
it to 1, then | created a password 
pattern where the first character was 
?u (A-Z), the next three were ?1 (a-z), 
and the final four were ?1 (0—9a-z). 
The complete command to attempt this 
mask attack against my phpass hashes 
with my new custom GPU tuning 
would be: 


/path/to/mp32.bin -1 ?d?1 ?u?1?121212?1?1?1 | \ 
/path/to/oclHashcat-plus32.bin -m 400 -n 80 \ 


-o recovered_hashes phpass-hashes 
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Attack Rules 

The final way to improve your 
attacks further is by applying rules 
to your dictionary attacks. A rule 
allows you to perform some sort 

of transformation against all the 
words in your dictionary. You might, 
for instance, not only try all your 
dictionary words, but also create a 
rule that adds a single digit to the 
end of the dictionary word. That will 
catch even more weak passwords and 
only increases the number of overall 
combinations by ten times. 

Here’s an even better example of 
how rules can help crack more tricky 
passwords. With the new requirement 
that users must have numbers in their 
password, a lot of users have resorted 
to “leet speak”. For instance, instead 
of using “password” they might use 
“p455wOrd”. The fact of the matter 
is, they still are using a dictionary 
word—they are just applying a basic 
transformation to it where a becomes 
4, s becomes 5, 0 becomes 0, e 
becomes 3 and so on. When you want 
to crack such a password, all you have 
to do is add the -r option to hashcat 
and point it to a file that contains the 
rule you want to apply. Hashcat uses a 
custom language to define rules, but 
it’s not too tricky to figure out, and the 
installation directory for oclhashcat has 
a rules directory that contains a number 
of rule files you can use as a reference. 
It even already includes a rule for leet 
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speak, so if you wanted to perform a 
dictionary attack that took leet speak 
into account, it would look something 
like this if you ran it from within the 
oclhashcat-plus directory: 


/path/to/oclHashcat-plus32.bin -m 400 \ 
-r ./rules/leetspeak.rule \ 


-O recovered_hashes example400.hash example.dict 


For more information about rules, 
check out the documentation on the 
Hashcat Wiki at http://hashcat.net/ 
wiki/rule_based_attack. 

You now should have everything you 
need to refine your (completely legitimate 
and white hat) password-cracking attacks. 
On the Hashcat Wiki, you will find even 
more examples of types of attacks and 
examples you can use to improve your 
odds of cracking a password hash. 


Kyle Rankin is a Sr. Systems Administrator in the San 
Francisco Bay Area and the author of a number of books, 
including The Official Ubuntu Server Book, Knoppix Hacks 
and Ubuntu Hacks. He is currently the president of the 
North Bay Linux Users’ Group. 


Resources 
Main Hashcat Site: http://hashcat.net 
Hashcat Wiki: http://hashcat.net/wiki 


Hashcat Rules Documentation: 
http://hashcat.net/wiki/rule_based_attack 
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Thin Clients 


If you have a few older computers and a second Ethernet card, 
give the Linux Terminal Server Project a try. 


One of my very first articles for Linux 
Journal was in August 2007 about the 
Linux Terminal Server Project (LTSP). 
The other article | wrote in that issue 
was about my MAME arcade system. 
Oddly enough, five years later, the 
most common questions | get from 
readers are about LTSP. And, the most 
common questions from my students 
are still about the arcade system! A lot 
has changed in the past half-decade, 
so in my next few articles, | explore the 
new face of thin clients. 


MueKow, Because Geeks Have the 
Best Code Names 

The term “thin client” often refers to 
a specific type of computer, but when 
it comes to LTSP, “thin client” means 
any computer that boots via the 
network and runs its operating system 
from a remotely mounted image. 


50 / MARCH 2012 / WWW.LINUXJOURNAL.COM 


The “thin” moniker is used because 
there is no need for the workstation 
to have a hard drive. This type of 
system offers several advantages over 
traditional workstations: 


H All workstations boot from a single 
image, meaning updates and changes 
need to be done only once. 


M The network “hard drive” is mounted 
in read-only mode, so it’s impossible 
to corrupt an individual computer. 


M Hard drive failures are no longer 
an issue. 


M Stolen workstations contain no 
data, because everything is stored 


on the server. 


The LTSP process works like this: 
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Version 5 of LTSP, code-named MueKow, 
changed the way the network-mounted 
system was created and maintained. 


1. Workstation boots via PXE. 


2. DHCP server tells workstation where 
to get its kernel. 


3. Workstation downloads kernel via 
TFTP. 


4. Workstation mounts root directory in 
read-only mode over the network. 


5. Workstation loads X11 locally and 
connects to the server. 


6. All programs, except for X11 itself, 
run on the server, requiring minimal 
resources on the thin client. 


In versions of LTSP before 5.0, the 
root directory was a specialized system 
mounted over NFS. It was stripped 
down to contain only the bits required 
to get X11 running, and then it pointed 
clients to the server via XDMCP. This 
had the advantage of requiring very 
minimal resources on the workstation 
(I'm talking requirements as low as 
Pentium | CPUs and 32MB of RAM or 
less). This also meant it was very difficult, 
or even impossible, to customize the 


workstation’s operating system. 

Version 5 of LTSP, code-named 
MueKow, changed the way the network- 
mounted system was created and 
maintained. Instead of a specialized Linux 
system, it used a chroot environment 
containing a minimal install of the same 
operating system running on the server. 
Workstations still booted the same way, 
but now the chroot environment could be 
updated and customized. There also were 
other changes under the hood, like using 
SSH instead of XDMCP and creating 
a custom display manager (LDM). An 
NBD (network block device) server was 
used instead of NFS, increasing network 
efficiency as well. 


If It Ain’t Broke, Why Fix It? 

A big motivation for changing the way 
LTSP managed its underlying operating 
system was that workstations, even 
outdated ones, were far too powerful 
to waste. Because traditionally, all 
applications ran on the powerful LTSP 
server, it would become overloaded 
quickly when users tried to run Adobe 
Flash or Java apps. With the new chroot 
environment, it became possible to run 
some apps locally and some apps on the 
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Figure 1. Old workstations make perfect 
LTSP thin clients. These machines were 
donated as junk, but they'll make excellent 
student workstations. 


server. This meant servers could handle 
more thin clients connected to them, 
and that workstations shared the load. It 
also meant a runaway by an application 
like Firefox would use 100% of the 
workstation CPU, and not the server. 
I'll dive into local apps in Part Il of this 
series, but | wanted to mention it now as 
it was a prime motivation for MueKow. 
LTSP 5's new methodology does 
increase the system requirements for 
the thin clients themselves. Basically, 
whatever server system you're running 
(Ubuntu 11.10, for example) must 
be supported for the thin-client 
hardware. Because Ubuntu 11.10 
requires at least a Pentium 4, so does 
LTSP 5 running on Ubuntu 11.10. (The 
Ubuntu kernel might actually boot 
on a Pentium 3, but if you're sticking 
with recommended CPUs, P4 is where 
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it’s at.) Because very little actually is 
running on the thin client itself, it’s 
possible to skimp on RAM. Although a 
minimum of 256MB is recommended, 
I've used 128MB systems successfully. 

So what this all means is that LTSP 
has shifted the responsibility of defining 
“minimal configuration” to the server's 
operating system. In general though, it’s 
good to have thin-client machines with 
the following: 


M Pentium 4 or greater CPU. 
M 256MB of RAM. 
HM PXE-bootable network card. 


If the computer doesn’t support PXE 
booting, it’s possible to use gPXE to 
boot the computer from the network. 
Although not terribly difficult to 
configure, gPXE is beyond the scope of 
this article. For more information, check 
out http://www.etherboot.org. 


We’ve Secretly Replaced Your Hard 
Drive with an Ethernet Port 

LTSP requires a good network 
infrastructure. There's really no way 
to sugarcoat it; it just does. Because 
the operating system is mounted 
over the network, any time the thin 
client needs to access its “hard 
drive”, it has to communicate over 
the network. Thankfully, LTSP 5 is 
more efficient at this than previous 
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versions, because instead of the 
traditional NFS-mounted filesystem, 
LTSP 5 uses NBD. The Network Block 
Device serves a single file, which 
is an image of the underlying file 
structure. This distinction means NBD 
is significantly faster and strains the 
network less than NFS. Even with that, 
however, LTSP requires a good network 
infrastructure. A gigabit-switched 
backbone with at least 100Mbit 
switched connections for each thin 
client is recommended. Anything less 
will really affect performance. 
Thankfully, by default, LTSP runs in a 
split network environment. That means 
the server has two Ethernet cards. One 
card connects to the main network, 
and the other creates a NAT to which 
the thin clients can connect. This is 
a great way to isolate a thin-client 
lab, especially when a beefy network 
infrastructure isn’t available. This 
method means the thin clients must be 
connected physically to the same switch 
as the NAT side of the server, but for 
smaller installations, that’s usually not 
a problem. (I'll talk about larger thin- 
client installs in later articles.) When 
failover and high availability come 
into play, a good site-wide network 
infrastructure is really required. 


It’s Not the Size of Your Server, 
It’s How You Use It 

Part of the confusion behind LTSP is 
that it’s very flexible, so a “standard” 


THE OPEN-SOURCE CLASSROOM 


install is a misnomer from the 
beginning. Like | just mentioned, the 
default installation method is to use 

a server with two Ethernet cards and 
create a private NAT’d network for 

the thin clients to live on. One huge 
advantage to this sort of install is that 
a modern workstation-class computer 
can act as a server for a small handful 
of thin clients. A dual-core workstation 
with 4GB of RAM easily could host 4-5 
thin clients and still work as a desktop 
workstation itself. This setup is very 
attractive for teachers who want to 
provide terminals for their classrooms. 

Every LTSP install is slightly different, 
so it’s also difficult to judge how big 
a “server” needs to be to support 
X number of thin clients. You can 
make some educated guesses, but 
honestly, the best way is to test and 
see. If Ubuntu recommends 512MB of 
RAM, you can see the aforementioned 
workstation/server has eight times as 
much RAM as is required. Based on 
that rough figure, 4—5 thin clients 
should be able to share the resources 
of the server computer and still run 
efficiently. That’s obviously a very 
rough figure, but you need to start the 
trial and error somewhere! 

Because LTSP depends so much on 
the network in order to function, your 
server, whatever size, really should have 
gigabit Ethernet. Thin clients can run 
just fine with 10O0Mbit connections, but 
the server should have gigabit. Once 
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If you have a server with two Ethernet cards, 
Ubuntu’s Alternate CD can set up everything 


you need automatically. 


Install Ubuntu 


Normal 
OEM install (for manufacturers) 
aS ceeceetesciet § lnstall a command-line system 


FL F2 F3 F4 FS F6 


Figure 2. Ubuntu’s Alternate CD makes installing 
an LTSP server simple. 


you have your server ready to install, 
and your thin clients (whether they are 
old workstations or fancy new thin- 
client devices) ready to boot from the 
network, it’s time to install LTSP. 


Ubuntu Makes Questions Easier to Ask 
| recommend Ubuntu for your first LTSP 
experience. The simple reason is that 
most LTSP folks use Ubuntu, so it’s 
easier to find support. Before version 5, 
LTSP was pretty closely tied to Red Hat- 
based operating systems. Now, with 
the MueKow concept, LTSP no longer is 
tied to a specific distribution. For the 
ourpose of this article, however, I’m 
assuming Ubuntu is the distribution 
used. (It should be fairly easy to adapt 
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to other distributions.) 

If you have a server with two 
Ethernet cards, Ubuntu’s Alternate 
CD can set up everything you need 
automatically. Boot up your server 
computer from the Alternate CD, and 
press F4. You'll see “Install an LTSP 
server” as one of the options (Figure 
2). If you select that option, Ubuntu 
installs like normal, and at the end 
of the install, you'll see it build the 
chroot environment for LTSP. 

Once the installation is complete, 
any thin clients connected to your 
second Ethernet card should be able to 
boot via PXE directly into an Ubuntu 
session. While I'm a big fan of magic, | 
also like to know how it works. So ina 
nutshell, here’s what's going on behind 
the scenes during the install: 


mM ATFTP server is installed and activated 
on the second Ethernet port. 


M A DHCP server is installed and 
activated on the second Ethernet 
port. (Note: it’s important to keep 
the second Ethernet port off your 
main network, because your DHCP 
server could mess up the rest of 
your network—keep the second 
Ethernet port separate!) 


COLUMNS 


M The LTSP-specific software is installed 
on the server. This includes things like 
LDM, which is the login screen thin 
clients display when they boot up. 


@ A minimal Ubuntu install is put into 
a chroot in your /opt/Itsp directory. 
This is a complete Ubuntu system 
with X11 support, but it has minimal 
applications installed, because by 
default, it launches only X11 then 
connects to the server. 


M The chroot folder is compressed into 
an NBD (Network Block Device) image. 


M@ An NBD server is installed and 
activated on the second Ethernet 
port, which serves the NBD image 
just created. 


M The kernel is copied from the chroot 
environment to the TFTP server. 


You’re Done—Now Get Started 

| mentioned the abstract process thin 
clients use when booting from the server. 
Now that you know how LTSP 5 is set up, 
let me elaborate a bit. When you power 


up your thin clients, this is what happens: 


1. The thin client, connected to the same 
network switch as the server’s second 
Ethernet port sends out a PXE request. 


2. The DHCP server responds, telling 
the thin client the address of the 


cP 


sf 
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server (192.168.1.254 by default) 
and the name of the kernel image 
to download. 


The thin client downloads the kernel 
via TFTP from the server's TFTP server. 


Once the thin client loads the kernel, 
it mounts the NBD image of the root 
filesystem via NBD. 


The thin client starts X11 and 
connects to LDM on the server. 


System on Module 


* TL ARM Cortex-A8 600 MHZ Fanless Processor, 

* Up to 512 MB of DDR2 SDRAM “ +t '.o 
* UP TO 1gb of NAND Flash 2 
* 2 High Speed USB 1.1/2.0 Host ports 

* 1 High Speed USB OTG port 

* 4 Serial Ports, 2 12C€ and 2 SPI ports 

* Processor Bus Expansion 

90/1/00 BaselRastEthernet 

* CAN 2.0 B Controller, 

* Neon Vector Floating Point Unit 

* 16-bit DSTN/TFT LCD Interface a 

* 2D/3D Accelerated Video w/ Resistive Touch 

* Small, 200 pin SODIMM form factor (2.66 x 2.375”) 


2.6 KERNEL 


The SoM-3517 uses the same small SODIMM form-factor utilized by other EMAC 
SoM modules, and is the ideal processor engine for your next design. All of the 
ARM processor core is included on this tiny board including: Flash, Memory, Serial 
Ports, Ethernet, SPI, 12C, 12S Audio, CAN 2.0B, PWMs, Timer/Counters, A/D, 
Digital I/O lines, Video, Clock/Calendar, and more. The SoM-3517M additionally 
provides a math coprocessor, and 2D/3D accelerated video with image 
scaling/rotation. Like other modules in EMAC's SoM productline, the SoM-3517 is 
designed to plug into a custom or off-the-shelf Carrier board containing all the 
connectors and any additional I/O components that may be required. The SoM 
approach provides the flexibility of a fully customized product at a greatly reduced 
cost. Contact EMAC for pricing & further information. 


http://www.emacinc.com/som/som3517.htm 


Since 1985 


“| EQUIPMENT A NT 


Phone: ( 618) 529-4525 « Fax: (618) 457-0110 e Web: www.emacinc.com 
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6. The thin client is ready to log in! 


With this basic install of LTSP, all 
applications are executed on the 
server. This is a confusing concept for 
many folks, but | explain to my users 
that a thin client is basically a remote 
keyboard/mouse/monitor for the server. 
When a user starts Firefox, for example, 
the application starts on the server— 
you just control it remotely. If you're 
familiar with X11 forwarding over SSH, 
the concept should be easier to wrap 
your brain around. 

Because everything is done on 
the server machine, any users or 
applications added to the server 
computer are available on the thin 
clients. This means LTSP users are 
simply users on the Ubuntu box, and 
they can be added or deleted using 
the standard Ubuntu tools. 

Even with my explanation of 
how thin clients boot and what 
the server does in the background, 
you'll notice there are still some 
mysterious things going on. Sound 
probably “just works” on the thin 
client, although that’s usually not the 
case with remote X11 apps. A few 
other hurdles have been conquered 
with LTSP 5 that historically were 
a problem. Things get much more 
complex when you start running some 
applications locally on the thin client 
and some applications remotely—but 
that’s for next month’s article. 
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This Month, Try to Break Things! 
Now that you have a fully running 
Ubuntu system on all your thin clients, 
see if you can find some of the 
limitations of such a system. If you have 
a classroom of kids to use as guinea 
pigs, have them use Adobe Flash-based 
Web sites, and see if you can notice your 
server slowing down. Install a printer on 
your server, and notice how all the thin 
clients automatically have access to it. 
Notice how LibreOffice loads lightning 
fast after it’s been opened on one 
machine (it gets loaded into memory). 
LTSP is a powerful way to utilize 
older hardware. It also can make system 
maintenance minimal, because there 
is only a single install of Ubuntu to 
keep updated. To be honest, I’ve barely 
scratched the surface in this article—you 
can tweak LTSP to do some amazing 
things. In my next few articles, I'll cover 
local apps, print servers, network tweaks, 
load balancing and more. If you have 
a few older computers and a second 
Ethernet card, | urge you to give LTSP a 
try. By the time you’re done, you'll be 
able to make your thin clients dance an 
Irish jig. (Or whatever the geeky network 
equivalent of Irish jigs might be!)m 


Shawn Powers is the Associate Editor for Linux Journal. He's 
also the Gadget Guy for LinuxJournal.com, and he has an 
interesting collection of vintage Garfield coffee mugs. Don’t let 
his silly hairdo fool you, he’s a pretty ordinary guy and can be 
reached via e-mail at shawn @linuxjournal.com. Or, swing by 
the #linuxjournal IRC channel on Freenode.net. 
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William E. Shotts Jr.’s The Linux eee 
Command Line (No Starch) COMMAND LINE 


Once you've dived into William E. Shotts Jr.’s The Linux Command 
Line: A Complete Introduction, you may find your mouse gathering 
dust, says the book’s publisher No Starch Press. In order to appreciate 
Linux's premier advantages fully—its power, customizability and rich 
UNIX-supercomputer heritage—every new user should fire up the 
Bash shell and explore what's possible with the command line. Shotts 
takes readers from first keystrokes to writing full programs in Bash. Along the way, hee 
will learn the timeless skills handed down by generations of gray-bearded, mouse-shunning 
gurus: file navigation, environment configuration, command chaining, pattern matching 
with regular expressions and more. In addition to that practical knowledge, Shotts reveals 
the philosophy behind these tools and the rich heritage that desktop Linux machines have 
inherited from their UNIX forebears. Shotts’ hope is that his readers eventually will find that 
the command line is a natural and expressive way to communicate with a computer. 
http://www.nostarch.com 


| sa | Eric Redmond and Jim R. Wilson’s 
Seven Databases in Seven Weeks 
(The Pragmatic Bookshelf) 


Seven Databases 
in Seven Weeks 


A Guide to Modern Databases 
and the NoSQL Movement 


Data is getting bigger and more complex by the day, and so are 
the choices in handling it. Cutting-edge solutions for managing 
this complexity range from traditional RDBMS to newer NoSQL 
approaches, seven of which are explored in Eric Redmond and Jim 
Wilson's new book Seven Databases in Seven Weeks: A Guide to 
Modern Databases and the NoSQL Movement. The book is a tour of some of the hottest 
open-source databases today that goes beyond basic tutorials to explore the essential 
concepts at the core of each technology. With each database—Redis, Neo4J, Couch, 
Mongo, HBase, Riak and Postgres—readers tackle a real-world data problem that highlights 
the concepts and features that make it shine. Readers also explore the five data models 
employed by these databases: relational, key/value, columnar, document and graph to 
determine which kinds of problems are best suited to each, and when to use them. 
http://www.pragprog.com 


Eric Redmond 
and Jim R. Wilson 
tatned by docqruety Caner 
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Xi3 Corporation’s TAND3M Software 


Go green and save green with Xi3 Corporation's 
TAND3M Software, an application that enables two 
people to share and use one (Linux or Windows) 

Xi3 Modular Computer for all computing functions 
simultaneously. Xi3’s CEO says that by taking 
advantage of the underutilized resources of the Xi3 
Modular Computer, the operating system and the 
other applications, computing costs are cut in half without a drop-off in performance. 
Each Xi3 Modular Computer needs only 20 Watts to operate, and the addition of 
TAND3M Software halves the electricity needs to a mere 10 Watts per seat. Such 

low power use is due in large part to Xi3’s unique architecture that separates the 
traditional computer motherboard into three distinct pieces: one for processor and 
memory option, a second for display and power options, and a third for I/O or special 
connectivity options. Xi3 says that its patented design and architecture solves many of 
the problems blocking the progress of advanced computing. 

http://www.Xi3.com 


Wind River Solution Accelerators for Android 


Intel subsidiary Wind River Software wants to help you jumpstart your Android 
device development with its new Wind River Solution Accelerators for Android. The 
three specialized software offerings—one each for user experience, connectivity and 
medical-specific devices—can accelerate Android device development and reduce 
engineering time and cost to help developers turn around high-quality devices 
faster than ever. Modular in nature, the offerings give developers flexibility to pick 
and choose software components to fill in gaps in expertise and instantly integrate 
complex, differentiating features. The user-experience module accelerates boot 
times and supports features like multi-windowing screen navigation, multimedia 
functionalities and advanced firmware management. The connectivity module 
supports multimedia interoperability capabilities via the DLNA standard, SyncML 
support and FM radio capabilities. The medical module helps medical device 
manufacturers leverage Android's platform richness and flexibility for innovation. 
http://www.windriver.com 
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Apache Hadoop 


Although the organizations that already use Apache Hadoop make up a Who's 
Who of the Net, this open-source framework for reliable, scalable, distributed 
computing officially has achieved the level of enterprise-readiness to earn 

a 1.0 designation. A foundation of cloud computing and at the epicenter 

of “big data” solutions, Apache Hadoop enables data-intensive distributed 
applications to work with thousands of nodes and exabytes of data. The 
framework enables organizations to store, process, manage and analyze the 
growing volumes of data being created and collected every day more efficiently 
and cost-effectively. It can connect thousands of servers to process and analyze 
data at supercomputing speed. Version 1.0 reflects six years of development, 
production experience, extensive testing and feedback. New features include 
support for HBase, strong authentication via Kerberos, Webhdfs, performance- 
enhanced access to local files for HBase and other features and fixes. The 
Apache Software Foundation directs the development of Apache Hadoop. 
http://www.apache.org 


Corel AfterShot Pro 


Corel, whose support for Linux goes way back 
in interesting ways (remember Corel Linux 
OS?), has announced the release of its new 
AfterShot Pro, an application the company 
markets as “a total photographic workflow 
solution for professional and enthusiast 
photographers”. Key product features include 
RAW workflow; flexible photo management; 
batch editing; robust metadata tools; easy 
integration with other image editors (such as 
Corel PaintShop Pro and Adobe Photoshop); 
advanced, non-destructive editing; and “breakthrough performance”. AfterShot Pro, 
which runs on Linux, Mac OS and Windows, is positioned as a powerful and affordable 
alternative to products like Adobe Photoshop Lightroom and ACD Systems ACDSee Pro. 
http://www.corel.com 
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“es m™ Opera TV Store 


If you thought Opera was just a niche 
browser company, think again. The company 
recently released its newest offering, the 
Opera TV Store, a HTML5-based store 
solution for connected TVs. Opera says that 
its goal with the TV Store is “to bring apps 
to the world of TV in a huge way” by providing users with a “lean-back Web experience” 
and to provide developers, content providers and manufacturers with “convenient, cross- 
platform technology”. The store is optimized for HD-Ready screens and standard remote 
controls, so users simply can fire up the cool apps, including video, games and news. The 
Opera TV Store can be installed by OEMs on any set-top box, Blu-ray player or HD-Ready 
TV, and manufacturers can harness the power of TV apps on any device running the 
Opera Devices SDK. Opera also says that “OEMs can rest assured that their users will get 
the best possible experience, without having to worry about the content themselves.” 
http://dev.opera.com/tv 
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After an intense, four-year-long slog, the developers 
of Scribus—the multiplatform, open-source, 
professional desktop publishing application—have : 
released the new stable version 1.4. The upgrade A 
integrates a whopping 2,000+ feature requests and 
bug resolutions. The most notable new feature is that Scribus 1.4 is now based on Qt4, 
which developers say enables it to run equally reliably on all supported platforms. Other 
feature highlights include improved object handling, advanced options for text and 
typography, undo/redo for nearly all text-related actions, usability improvements, new 
features for vector objects, better fill handling, additional color palettes, a rendering 
frame, more vector import filters and much more. 

http://www.scribus.net 


Totaled e 


Please send information about releases of Linux-related products to newproducts@linuxjournal.com or 


New Products c/o Linux Journal, PO Box 980985, Houston, TX 77098. Submissions are edited for length and content. 


WWW.LINUXJOURNAL.COM / MARCH 2012 / 61 


Swap Your 
Laptop for an 
iPad + Linode 


Ditch your laptop and code in the cloud—it’s easier 


than you’d think. 
MARK O'CONNOR 


n September 19, 2011, | said 
goodbye to my trusty MacBook 
Pro and started developing 
exclusively on an iPad + Linode 512. This 
is the surprising story of three months 
spent working in the cloud. 
It all started when | bought my first 
MacBook a couple years ago; despite 
a decade using Linux, | never really 
was Satisfied with either GNOME or 
KDE. In OS X, | hoped to find a slick 
window manager on top of a solid BSD 
implementation. | enjoyed hardware with 
drivers that “just worked”, but | missed 
decent package management and the 
rest of the Linux ecosystem. 
Although | like to use Python and GAE 
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for my own projects, at work, we write 
heavyweight C++/Qt code that runs on 
clusters, such as the 200,000 processor 
Jaguar machine, so most of my day was 
spent in Linux anyhow, a lot of it on 
remote systems. Typically, I'd develop in 
MacVim locally and run my code remotely 
or on Ubuntu under VMware Fusion. 

One fateful day, VMware and OS X 
conspired to trash my shared filesystem. 
While dd was recovering as much as it 
could, | started toying with the idea of 
giving up on local filesystems altogether. 
To my surprise, it seemed possible—even 
plausible. The more | thought about it, 
the more attractive it seemed. | knew 
then, | just had to try. 


Figure 1. 
iPad on Sofa 


enum Status 
{ 


KotStarted. 
43 Running, 
44 Stopped, 
45 Terminated 


corautine(), . 
50 virtual -Coroutine(): 


: woid createStack(int size = DefaultStackSize); 
53 void setStack(void *memory. int size): 
54 void setAutoDelete(bool autoDelete) ; . 


55 bool autoDelete() const 
i { return autoPelete; } 


bool cunt(): 
static void yield{): 


Status status() const 
{ return status; } 


bool isRootCoroutine() const; 


void stackInfo(woid **data, size t *size, void °“base, void *°*current) const: 


static Coroutine *currentCoroutine{); 
fifdef ado 
static Coroutine *build{Function function, ...}; 


include coro 


Falpcivate: wot copyable 
80 Coroutine(const Coroutine &); 


Coroutine &operator=(const Coroutine &); 


rivate: 
static void yieldHelper(Status stopStatus); 
static void entryPoint(); 

void freeStack(): 


void * stackData; 
size t stackSize; 
void * stackBase; 
void * stackPointer; 
Coroutine * caller; 
Status status; 

bool autoDelete; 
bool ownStack; 


89 include 
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Figure 2. iPad and Keyboard Box 
The Setup 
It turns out you need a little more than 
just an iPad and a dream, but not too 
much more: 

iPad 2 (16Gb, Wi-Fi). 

Apple wireless keyboard. 


Stilgut adjustable angle stand/case. 


iSSH (and optionally Jump). 
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Linode 512 running Ubuntu 11.04. 


Apple VGA adapter. 


Total cost: around $800 + $20 
per month. 


| chose a Linode 512, which has been 
perfect for my needs. You get fantastic 
CPU power and a tiny little bit of RAM. 
Surprisingly, this is enough when you 
do most of your work at the command 
line, but it’s nice knowing | always can 


upgrade it later. 

| also turned on the $5-a-month 
backups. Zero-effort data safety for 
less than the price of a hot chocolate? 
Yes, please! 

Linode’s interface walks you through 
adding your new node. Pick a region 
close to yourself—you want to minimize 
the roundtrip time to the server. | spend 
most of my time in Munich, so | have 
mine in London and get a 30-40ms ping, 
which is great. 

| run Ubuntu 11.04 in 32-bit mode on 
mine, but they offer a wide selection of 
pre-built Linux images along with the 
option to install your own. 

For access to the server, you need a 
really good SSH client. On the iPad, I’ve 
tried both iSSH and Prompt, and of these, 
only iSSH is even feasible for serious use. 
The hardest part of setting up an SSH 
client on a tablet is getting your private 
SSH key on there without entrusting it to 
a third party. | split mine across multiple 
services and removed it after recombining 
it, but a better way would be to SSH in 
with a password first, then use copy and 
paste to copy the key inside iSSH itself. 


I Wandered Lonely as a Cloud 
| typically start my day by catching up 
on the bug-tracker chatter, mercurial 
diffs and other e-mails with the 
iPad in one hand while lying on the 
Combinat56 sofa. 

| actually hate the mail app for this— 
the stupid animation when archiving 


posts adds unnecessary delay, and the 
archive button is uncomfortably placed at 
the top of the screen. More recently, I’ve 
been scanning e-mails over IMAP with a 
Python script instead. 

Next, | lazily swipe to Safari and review 
my tickets for the day in our Web-based 
bug tracker then return to the keyboard 
and fire off a couple e-mails before 
settling back into coding—the new four- 
finger swipe gestures in iOS5 have really 
improved my life. 

But, | was talking about coding, which 
brings me back to the only reason this 
setup works for me at all: Vim. 


Vim: My Home from Home 
Perhaps the only reason this transition 
has been so smooth is because my 
favourite editor/IDE looks and feels 
almost exactly the same running on an 
iSSH console as it did running locally 
on my MacBook. iSSH supports 
xterm-256color, which means you still 
can have pleasant color schemes despite 
working in a terminal. All my plugins 
are there, my code-completion, quick 
navigation and so on. 

| found Ubuntu’s default Vim didn’t 
have everything | wanted, but don’t 
worry! It’s easy to download and build it 
yourself. See Listing 1 (also available at 
https://gist.github.com/1357690). 

| honestly can’t remember which 
plugins | installed and which ones | 
actually use. | just copied the existing 
vim folder from my MacVim installation. 
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8:28 PM 


Ctrl Alt fees & Fe | 
from pattern.graph import Graph, export, GraphSpringLayout 
from commenters import correlate_commenters, sample_commenters, top_commenters 


def graph_commenters(top, stories, name): 
correlations = correlate_commenters(top, stories) 
all_commenters = set(cl for cl, c2, correlation in correlations) 


g = Graph() 


for cl, c2, correlation in correlations[:len(top)]: 
if correlation > @.25: 
g.add_node(cl, radius=size(cl, top)) 
.add_node(c2, radius=size(c2, top)) 
g.add_edge(cl, c2, weight=correlation) 


layout = GraphSpringLayout(g) 
while layout.iterations < 1000: 
layout.update() 
export(g, % name, repulsion=15, width=2048, height=1538, overw 
rite=True, frames=1) 


def size(c, commenters): 
return 50.@ * float(commenters[c]) / max(commenters.itervalues()) 


if __name__ == : 
top, stories = top_commenters(50, sample_commenters(1.0)) 
graph_commenters(top, stories, 
graph_commenters(top, stories, ») 


"sraph.py” line 1 of 28 --3%-- col 1 


0$ cc sh 1-$ cc vim 2$ fm py 3*$ fm vim 


Figure 3. Vim on iPad 


Listing 1. Building Vim | definitely use these every day though: 


install-vim.sh # ®@ avim 


apt-get install mercurial cctree.vim 
apt-get build-dep vim 

hg clone https://vim.googlecode.com/hg/ vim 4] clang_complete.vim 

cd vim 

./configure --enable-rubyinterp --enable-pythoninterp ai] color_sample_pack.vim 
=»--with-features=big 

make m@ command-t.vim 


make install 


cscope_maps.vim 
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M NERD_tree.vim install clang should do the trick. | 
had to play around with it a bit to get it 


M scratch.vim working on my project, which included 
adding all the -l and -D command-line 

® searchfold.vim options to a .clang-complete file in the 
project directory. 

You can get them all from Everybody configures Vim differently. 
http://www.vim.org/scripts, but Listing 2 shows my .vimrc (also available 
you may want to install pathogen and at https://gist.github.com/1357590). 
get them that way instead. Note that Some of the things here relate to our 
command-t requires you to build a internal tracker system and won't be 
stub—follow the install instructions in interesting for you, but it should be clear 
command-t.vim, and it just works. what most of these things do and which 

To use the clang_complete plugin, keys are bound to them. 
you'll need clang. Typing apt-get In short, it’s a seamless transition 


Listing 2. .vimrc 


"Set Mapleader "ddt log files 
let mapleader = "," map <Leader>gdb :!cdata-from-log % >/tmp/cdata. log<cr>:e 
let g:mapleader = "," »/tmp/cdata. Log<cr> 
"Theme "Disable virtual bell 
colo zenburn set vb t_vb=" 
"NERDTree "Make backspace work 
map <Leader>, :NERDTreeToggle<cr> set backspace=2 
"Taglist "Code navigation 
et Tlist_Ctags Cmd = '/usr/local/bin/ctags' map <Leader>gd ?“{<cr>kf:11 
et Tlist_WinWidth = 50 
map <Leader>. :TlistToggle<cr> "Misc stuff 
set autoread 
"Check python syntax set hidden 
et g:pcs_hotkey = '<LocalLeader>x' set hlsearch 
set incsearch 
"Quick Open set ignorecase 
et g:CommandTMaxF i les=30000 set smartcase 
set wildignoret=*.o, .ddt-*, .treeserver-* set smartindent 
et g:CommandTMatchWindowAtTop = 1 map <Leader>c :let @/ = ""<cr> 
syntax enable 
"Scratch buffer set nu 
map <Leader>k :ScratchOpen<cr> set textwidth=0 " No annoying word wrapping 
set tabstop=4 
ARI set shiftwidth=4 
map <Leader>rt "zyiw:ScratchOpen<cr>:@r!~/Work/code/util/rt show -f set expandtab 
‘id, Subject Queue, Status ,Creator ,Owner,LastUpdated, Priority set guifont=Menlo:h14 
ticket/<C-R>z<cr>0<Esc> filetype on 
map <Leader>tt "zyiw:r!~/Work/code/util/rt show -f Subject ticket/<C-R>z filetype plugin on 
»\| grep Subject \| cut -d' ' -f2-<cr>kA:<Esc>Jj set nocp 
autocmd FileType python set omnifunc=pythoncomplete#Complete 
"ctags autocmd FileType javascript set omnifunc=javascriptcomplete#CompleteJS 
set tags=tags ; $HOME autocmd FileType html set omnifunc=htmlcomplete#CompleteTags 
autocmd FileType css set omnifunc=csscomplete#CompleteCSs 
"Rebuild cscope autocmd FileType xml set omnifunc=xmlcomplete#CompleteTags 
map <Leader>cs !cscope -bqk<cr>:cs add cscope.out<cr> autocmd FileType php set omni func=phpcomplete#CompLetePHP 
"Replaced by clang_complete for now 
"Buffer shortcuts "autocmd FileType c set omnifunc=ccomplete#CompleteCpp 
map <Leader>f :b#<cr> autocmd FileType ChangeLog set tw=80 
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from my MacVim environment. If | were 
developing OS X apps with Xcode or used 
Eclipse or Visual Studio regularly, this 
change probably would have killed me. 

As it happens, working in the terminal 
on a remote Linode Is even better than 
working locally, thanks to the magic of 
GNU Screen. 


GNU Screen Is Magic 

GNU Screen Is like a window manager 
for your terminal sessions, giving 

you multiple tabs, searchable history, 
activity/idle notifications and—best of 
all—persistence. 

So, | fire up iSSH, tap on my Linode 
connection and reconnect to the 
already-running Screen session. All my 
terminal tabs are exactly where | left 
them. Other SSH tunnels still are set up. 
My cursor still is in the same position. 
The clipboard is as | left it. It’s as if | 
never left, because for my side projects, 
| have a different Screen session with a 
different set of tabs and editor instances 
running—perfect separation. 

It’s hard to overstate how pleasant 
it is to be able to return to exactly 
the same session each day. Ona 
MacBook, there'd usually be some 
other distracting programs left that I'd 
opened in the meantime, and of course, 
any remote connections would have 


been dropped. At the very least, I'd 
have used MacVim for something else 
in the evenings. It might be a largely 
osychological benefit, but it feels as if 
| can drop back into the flow almost 
as easily as | left it. (Listing 3 shows an 
example .screenrc file, also available at 
https://gist.github.com/1357707.) 


The Good, the Bad and VNC 
At work, we develop a graphical parallel 
debugger, so | can’t spend all my time in 
the terminal. For hands-on tests and GUI 
work, | need X. iSSH has a workable, if 
not perfect, solution, but for a few extra 
dollars, | find Jump far superior. 
Although it’s still not as quick and 
accurate as using a mouse to interact 
with a traditional GUI program, both 
iSSH’s on-screen “touchpad” and 
particularly Jump’s tap circle work better 
than I'd expect. And as it happens, being 
limited isn’t all that bad: 


One good way to evaluate the 
usability of a program or dialog is to 
try to use the mouse with just one 
tinger.—Joel Spolsky 


VNC on the iPad isn’t nearly as bad 
as pushing the mouse around with one 
finger, but it does make you consider 
users with lower screen resolutions, 


py” line 1 


of 28 --3%-- col 1 


sh 1-$ cc vim 2$ fm py 


Figure 4. GNU Screen Bar 
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3*$ fm vim 


Listing 3. .screenrc 


a 
# Example of a user's .screenrc file 
# 


# This is how one can set a reattach password: 
# password ODSJQf.4IJN7E # "1234" 


# no annoying audible bell, please 
vbell on 


# detach on hangup 
autodetach on 


# don't display the copyright page 
startup_message off 


# emulate .logout message 
pow_detach_msg "Screen session of \$LOGNAME \$:cr:\$:nl:ended." 


# advertise hardstatus support to $TERMCAP 
# termcapinfo * '' 'hs:ts=\E_:fs=\E\\:ds=\E_\E\\' 


# make the shell in every window a login shell 
#shell -$SHELL 


# autoaka testing 
# shellaka '> |tcsh' 
# shellaka '$ |sh' 


# set every new windows hardstatus line to something descriptive 
# defhstatus "screen: “En (Et)" 


defscrollback 1000 


# don't kill window after the process died 
# zombie "4[" 


THAR HET HEE 
# 

# xterm tweaks 

# 


#xterm understands both im/ic and doesn't have a status line. 
#Note: Do not specify im and ic in the real termcap/info file as 
#some programs (e.g. vi) will not work anymore. 

termcap xterm hs@:cs=\E[%i%d;%dr : im=\E[4h:ei=\E[41 

terminfo xterm hs@:cs=\E[%i%p1%d ; %p2%dr : im=\E[4h: e7=\E[41 


#80/132 column switching must be enabled for “AW to work 
#change init sequence to not switch width 

termcapinfo xterm ZO=\E[?3h:Z1=\E[?31:is=\E[r\E[m\E[2J\E[H\ 
wE[?7h\E[?21;4;61 


# Make the output buffer large for (fast) xterms. 
termcapinfo xterm* OL=10000 


# tell screen that xterm can switch to dark background and has 
# function keys. 

termcapinfo xterm 'VR=\E[?5h:VN=\E[?51' 

termcapinfo xterm 'k1=\E[11~:k2=\E[12~:k3=\E[13~:k4=\E[14~' 
termcapinfo xterm 'kh=\E[1~:kI=\E[2~:kD=\E [3~:kH=\E [4~:kP= 

> \E[H: kN=\E[6~' 


# special xterm hardstatus: use the window title. 
termcapinfo xterm 'hs:ts=\E]2;:fs=\007:ds=\E]2;screen\007' 


#terminfo xterm 'vb=\E[?5h$<200/>\E[?51' 
termcapinfo xterm 'vi=\E[?251:ve=\E[34h\E[?25h:vs=\E[341' 


# emulate part of the 'K' charset 
termcapinfo xterm 
"XC=K%, %\E(B, [\304,\\\\\326, ]\334, {\344, |\366, }\374,~\337' 


# xterm-52 tweaks: 
# - uses background color for delete operations 
termcapinfo xterm be 


THAIS it 
ca 
# wyse terminals 
# 


#wyse-75-42 must have flow control (xo = "terminal uses xon/xoff") 


#essential to have it here, as this is a slow terminal. 
termcapinfo wy75-42 xo:hs@ 


# New termcap sequences for cursor application mode. 
termcapinfo wy* 
CS=\E[?1h:CE=\E[?11:vi=\E[?251: ve=\E[?25h: VR=\E[?5h: VN= 
\E[?51:cb=\E[1K:CD=\E[1J 


TBH 
# 
# other terminals 
# 


#make hp700 termcap/info better 

termcapinfo hp700 

"ZO=\E[?3h:Z1=\E[?31:hs: ts=\E[62"p\E[0$~\E[2$~\E[1$} : fs= 
> \E[O}\E[61"p:ds=\E[62"p\E[1$~\E[61"p:ic@' 


# Extend the vt100 description by some sequences. 

termcap vt100* 

ms : AL=\E[%dL : DL=\E [%dM: UP=\E [%dA : DO=\E [%dB: LE=\E [%dD : RI=\E [%dC 
terminfo vt100* 

ms : AL=\E[%p1%dL : DL=\E [%p1%dM : UP=\E [%p1%dA : DO=\E [%p1%dB : LE= 

> \E [%p1%dD : RI=\E [%p1%dC 

# terminfo and termcap for nice 256 color terminal 

# allow bold colors - necessary for some reason 

aE nCOMOTe biter le 

# tell screen how to set colors. AB = background, AF=foreground 
termcapinfo xterm-256color 'Co#256:AB=\E[48;5;%dm:AF=\E[38;5;%dm' 
# erase background with current bg color 

defbce "on" 


TERE RE 
# 

# keybindings 

# 


#remove some stupid / dangerous key bindings 
bind k 

bind *k 

bind . 

bind *\ 

bind \\ 

bind “h 

bind h 

#make them better 
bind) "K” (Kill 

bind 'I' login on 
bind '0' login off 
bind '}' history 


# Yet another hack: 

# Prepend/append register [/] to the paste if *a%] is pressed. 
# This lets me have autoindent mode in vi. 

register [ "\033:se noai\015a" 

register ] "\Q33:se ai\015a" 

bind “] paste [.] 


TAREE 


# default windows 


# screen -t local 0 
# screen -t mail 1 elm 
# screen -t 40 2 rlogin faui40 


# caption always "%3n %t%? @%U%?%? [%h]%?" 
# hardstatus alwaysignore 
# hardstatus alwayslastline "%w" 


bind = resize = 
bind + resize +1 
biAde-sesizen— 
bind _ resize max 


attrcolor u "-u b" 
attrcolor b "R" 


HH RH HHH 


hardstatus alwayslastline 

hardstatus string '%{gk}[ %{G}%H %{g}] [%= %{wk}%?%-Lw%?%{=b kR} 
wm (H{W} MN *WFVt%? (MU) %?%{=b KR})%{= kw}%?%+LwH?%?2%= 

we %{}] [%{Y}%1%{g}] %{=b C}[ %m/%d %c%] %{W} ' 
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larger font sizes and mouse control that 
hasn't been honed by countless years 
playing Quake and Starcraft. |'d be 
lying if | said | hadn't wished iOS had 
Bluetooth mouse support some days. 


Maybe It’s a Lifestyle 

Today is not one of those days. | unwrap 
a chocolate croissant, make a fresh cup 
of tea and settle down to work: a quick 
hg pull -u && make to start the 
recompile, then Ctrl-X to my editor tab 
and carry on coding while the rebuild 


Figure 5. iPad and Croissant 


70 / MARCH 2012 / WWW.LINUXJOURNAL.COM 


happens. Ctrl-X is my screen's “hot key”; 
it defaults to Ctrl-A, but on a wireless 
keyboard, that leaves Unicode characters 
in the terminal—I assume this is related 
to Apple’s support for some common 
Emacs keybindings in iOS. It’s strange, 
but easy enough to work around—unless 
you're an Emacs user, | imagine. 

After a few minutes of coding, the bar 
at the bottom of the screen notifies me 
that my compile has finished. | Ctrl-x 
back, start a sanity test suite running just 
to be sure nothing horrible was broken 


overnight, then carry on coding again. 
Compiling on the quad-processor Linode 
is around twice as fast as inside VMware 
on my MacBook was. It’s also completely, 
blissfully silent. The only sound is the 
raindrop-like patter of the keyboard as 

| work. It doesn’t even get warm—a 
surprisingly refreshing change from the 
keyboard of a hard-working laptop! 

| swipe to the DuckDuckGo app and 
look something up in the Qt APls, then 
swipe back. It’s becoming second nature, 
but | still miss a keyboard shortcut for 
task switching. 

After an hour or two of uninterrupted 
development, the UK team wakes up and 
the first instant messages arrive. Thank 
heaven for the iOS5 update! | use the 
imo messenger app, which is fine, but 
of course, before the notification center, 
each pushed message would interrupt 
whatever | was doing with a frustrating 
pop-up. Now, the new notifications 
center behaves much more like a growl 
notification would—it lets me know, and 
it gets back out of the way again. 

| finish the function | was working 
on, then four-finger swipe to the chat 
app; it’s my boss reminding me about 
our 11am conference call. 

Skype-based conference calls work 
fine on both the iPad and the iPhone; at 
least, as well as VoIP calls ever work— 
that is, fine after a few false starts 
while someone reconfigures the Linux 
audio drivers. | appreciate not having to 
think about that anymore—with a thin, 


consumer client and a powerful Linux 
server, I’m really enjoying the best of 
both worlds. 

During the Skype call, my iSSH session 
timed out in the background. It’s only 
held for ten minutes or so. Fortunately, 

a single tap reconnects me, and through 
the magic of GNU Screen, I’m back at 
exactly the place | left off again. 

As is always the case, while fixing 
one bug, | encounter another, apparently 
unrelated one. 

Instead of messing around with some 
Web interface, I’ve switched to grabbing 
screen dumps (Il recommend vncsnapshot) 
and any log files or stack traces with a 
command-line script run on the Linode 
itself. We use the Best Practical RT 
tracker (for our sins), which conveniently 
comes with a Perl script to interact 
with it from the command line. Doing 
this is actually quicker and easier than 
uploading via a browser used to be—one 
command with a bug description and the 
attachments, and I’m done. 


The Cloud Is Always with You 
And, it’s lunchtime already! | close the 
iPad and head off with the others. The 
remote rebuild | left going will still be 
there—no need to worry about any 
uploads getting interrupted; it’s all 
happening in on the Linode, after all. 
During lunch, | pull out my iPhone 
and connect to the Linode again. 
Unfortunately, the build failed early on— 
out of disk space on one of the office 
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ail, Telekom.de @& 10:48 PM SA mwas = Kick off a new build 
Tm root 2 | | S . y, while waiting for 


9900800 kworker/u:1 . dessert to arrive. 
he ; ° Now I’m feeling 
nicely fed and just 
a little drowsy. 
To keep awake, | 
move to a standing 
workstation and 
set off some 
longer-running 
performance tests 
on a remote cluster. 
| find | move around 
between a lot of 
different working 
configurations with 
the iPad—much 
more frequently 
than when using a 
laptop. I’m not sure 
why—perhaps It’s 
something about 
having a separate 


keyboard and 


a screen that makes 
comfortable typing 


~/Work/code /ddt /1ibexec 
1$ vim 2-S 


position, or perhaps 


it’s just the novelty. 
ABC @& return The tests will 

take an hour or so. 
Figure 6. iPhone SSH | close ISSH and 


review the latest 
staging machines. The iPhone keyboard spec/schedule changes my colleagues 
is somewhat painful to use, but for rm have made to an upcoming spec, stored 
-rf /tmp/build-2011-* it suffices. | in Google Docs. 
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Oh, Google Docs, Why Do You Hate Me So? 
In a bitterly ironic twist, the only part of 
working in the cloud that doesn’t work 
smoothly is using Google's cloud-based 
MS Office replacement. The mobile word 
processor is a joke, frequently losing the 
cursor position and sizable chunks of text. 
The spreadsheet version is better, but it’s still a 
pathetic experience compared to the desktop 
version. There are no good native apps, so the 
only thing to do is to force Google to show 
the desktop versions of the sites and ignore 
the script errors. | wish | could convince my 
team to switch back to OpenOffice.org. 

The tests have finally finished and the 
results are in. | move to the lounge area 
and connect to the big HD TV with the VGA 
cable—something about seeing console-mode 
Vim in giant HD makes me smile every time. 

There are some oddities in the logs. | copy 
and paste a few snippets to a colleague 
and discuss them in chat. I’m glad copy and 
paste work smoothly, although having three 
different sets of buffers (iPad, Screen, Vim) 
does lead to confusion from time to time. 
Idly, | wonder if any of my colleagues have 
noticed I’ve been using an iPad instead of a 
laptop for the last month. 

Six pm rolls around, and it’s time 
to head home for the day. Despite a 
full day’s intensive use, my iPad is still 
showing 15% battery life. | never bring a 
charger to work, and I’ve never needed 
one. That in itself is a taste of freedom. 


At the End of the Day 
Later that evening, | pull the iPad out and 


open up Pages to finish a blog post. The 
house is quiet. Only the distant sounds of 
the city drift in from outside and mingle 
with the gentle patter of key presses on 
this delightful wireless keyboard. 

| started this experiment because | 
fundamentally believe that most people 
don’t want to rearrange windows, babysit 
their own general-purpose computers or 
back up their data. Sooner or later, almost 
everyone will work like this, and | wanted 
a taste of what that might feel like. | 
expected to find something that didn’t 
work, but as the days turned into weeks 
and the weeks into months, | found | 
hadn’t returned to my laptop even once. 

| don’t miss the weight. | don’t miss the 
keyboard getting warm when I’m compiling. 
| don't miss its fragility, both physically and 
virtually. | don’t miss running out of power. 
To my surprise, | find | am happy. Coding 
in the cloud isn’t for everybody, but for my 
work flow, it’s a perfect fit and | love it. 

After a few minutes, the perfect peace 
is rudely disturbed by the twin jet-engine 
that is my MacBook fans spinning up to full 
power on the shelf behind me. | can’t believe 
| used to put up with this all day and night. 

Despite that, | leave the MacBook running. 
It's doing the only thing | still need it for on a 
regular basis. It’s ripping DVDs.™ 


Mark 0’Connor is a Munich-based programmer, occasional 
writer and part-time startup founder. He believes in 
dynamic typing, first-class functions and the immortal 
essence of the human soul. He also likes tea. You can 
reach him at @yieldthought or http://yieldthought.com. 
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Plasma 
Active 


a New Approach to 
Tablet Computing 


KDE lines up a truly free tablet operating system. 


STUART JARVIS 

hy would you spend a few managing more than a pre-release. It 
W hundred dollars on a device presented a few simple options, such 

that is little more than as watching videos, playing music or 
a smartphone (with a bigger screen, browsing the Web—really no more than 
without the phone)? a modern phone with a larger screen. 

Despite the success of Apple’s iPad, Even the iPad, an acknowledged success, 

that is a question that seems to have is little more than an oversize iPhone. Its 
defeated most hardware and software “wall of apps” approach has been largely 
vendors. MeeGo struggled to define copied by the Android-based tablets so 
a tablet user interface, never quite far appearing on the market. 
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What Are Tablets For? 
The tablet sitting in your hand (or 
unused in one of your drawers) is a 
real computer. Can it do more than 
browse the Web and play videos? 
Marco Martin, well-known KDE hacker 
and basysKom employee, thinks so: 
“the fact that people download and 
use thousands of apps shows that there 
is the desire to do something more”. 
He dislikes the way “most mobile 
applications feel quite disconnected 
with each other”. Marco believes this 
is where KDE’s new user interface and 
application set for touchscreen devices, 
Plasma Active, can shine. 

Plasma Active takes a new approach 
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to touchscreen devices and tries to offer 
more than a set of applications for simple 
tasks. More than a desktop or even a 
notebook computer, a touchscreen device 
is likely to be carried around and used in 
different contexts, for different purposes. 
Plasma Active makes use of KDE’s 
Activities, something that has confused 
desktop users (see the Activities—a 
Solution Looking for a Problem? sidebar) 
but, the developers believe, makes sense 
on tablet devices. 

Aaron Seigo, a founding member of 
the Plasma Active Project and one of 
the main drivers behind KDE's Plasma 
family of user interfaces, hails Activities 
as a great step forward, claiming that 
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Figure 1. Plasma Active comes with a selection of applications, some more ready for touchscreens 
than others. 
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Activities—a Solution 
Looking for a Problem? 


Since 2008, KDE has been pushing the concept 
of Activities, with mixed results. Many users 
have not been sure of the difference between 
Activities, designed to allow division of different 
types of tasks, and virtual desktops, which many 
people use to divide different types of tasks. 


The idea is that although virtual desktops provide 
extra space and some grouping—for example, you 
might have different desktops for e-mail, Web, 
numerical work and graphics work—Activities 
provide customized interfaces for different tasks 
at different times. 


Imagine you are a student at university. You might 
use virtual desktops as described above—with 
e-mail on one and lecture notes on another. But 
you might use Activities to differentiate between 
your courses, having one Activity for each set of 
lectures. So you can have a calculator widget on 
your desktops for your math lectures Activity, the 
periodic table for your chemistry lab Activity and 
quick access to your games in your free-time 
Activity. With its quick switcher and per-Activity 
recommendations, Plasma Active takes this 
concept further, making your tablet change its 
configuration completely at the scroll of the 
Activities wheel, so you can have it set up just 
how you want for every task you experience. 
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“many find the ability 

to sort their information 
and applications between 
different activities greatly 
increases the value of 

the device in their lives”. 
He uses a personal 
example: “while ona 
recent vacation | relied on 
Activities to keep track of 
our itineraries and plans, 
some work tasks and 

to keep up with things 
back home. | have a few 
Android tablets, and none 
of them would have been 
nearly as useful.” 


First Impressions 

When you launch Plasma 
Active for the first time 
(see the Try Plasma Active 
Two sidebar for how to 
try it), you are presented 
with what appears to 

be a fairly standard KDE 
desktop. The main things 
out of place are a panel 
at the top of the screen 
and the lack of an obvious 
application menu. Two 
small tabs halfway up 
either side of the screen 
also are not found in 
other KDE workspaces. 
Between them, these 
three items provide your 


SELECTING AN ACTIVITY CHANGES THE DESKTOP 
BACKGROUND AND DESKTOP WIDGETS TO THOSE 
ASSOCIATED WITH THE ACTIVITY. 


Bookmarks (2) 
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Figure 2. You can customize each Activity with widgets and switch between them easily using the 


Activities wheel. 


control of Plasma Active. Drag the top 
panel down a little, and you will see a 
wide, touch-friendly task bar, with live 
previews of the running applications 
and the Home Screen that effectively 
minimizes all running programs. Drag a 
bit farther down, and you are presented 
with a wall of application icons, not 
unlike those provided on Android or 
Apple tablets, with a search box you 
can use to locate the correct application 


quickly. So far, not so very revolutionary. 


Adapting to Different Tasks 

It is the two tabs on the sides of the 
screen that are unique to Plasma Active. 
The tab on the right, when dragged 
out, reveals a wheel of Activities, each 
represented by a thumbnail image. A 
few selections are predefined, including 
“Introduction” that provides some 
information on getting started; “Vacation 
planning”, set up for just that; and “My 
first activity”, which invites you to make 
your own. You can delete, customize or 
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Try Plasma Active Two 


The latest release of Plasma Active is easy to try out. If you already have a computer 
running MeeGo or OpenSUSE, you can install the needed packages. However, a safer 
and more convenient option is to try one of the ready-made live images—you always 
can install them if you decide you like Plasma Active. Live images on a MeeGo base are 
provided by basysKom, while open-slx provides an image built on its OpenSUSE-based 


Balsam Professional distribution. 


You even can try Plasma Active on ARM devices (such as an Android tablet) using an 
image built on Mer, the port of a MeeGo-like system to the ARM architecture. 


Details of all the installation and testing options can be found on the KDE Wiki 
(http://community.KDE.org/Plasma/Active/Installation). 


The performance of the live images depends on your USB stick and your tablet device. 
You can install the software to get better performance, but that may, of course, overwrite 


your existing operating system. 


As Plasma Active—and tablet devices—become more widespread, it is likely that many 
distributions will begin to offer Plasma Active as a user interface or provide special 
mobile-optimized distributions with Plasma Active. 


As Aaron Seigo of KDE notes, “a solution only really matters if people can use it”. 
You also may one day see Plasma Active devices for sale—the Plasma Active team is 
“working quite hard on making this a reality in the near future”. 


add activities using icons that are visible 
with the Activity wheel. 

Selecting an Activity changes the 
desktop background and desktop 
widgets to those associated with the 
Activity. Choose the vacation planning 
Activity, and you are presented with a 
picture of a hay field as the desktop 
background and have the KDE weather 
forecast widget and bookmarks for 
OpenStreetMap, Wikitravel and a rail 
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operator on your desktop. You can open 
a browser and start booking your holiday, 
but if your child (or you) suddenly has 

an overpowering urge to play Solitaire, 
you can just switch to an Activity set 

up for games. If you check the task bar 
by pulling down the top panel, you will 
see that it shows only the applications 
from the current Activity, so your holiday 
booking in the vacation planning Activity 
is safe from little fingers accidentally 


KFourinune 


KMahjongg 


DAS 


Figure 3. You can have an Activity for all the things you need to do—and for the things you want to do. 


closing the browser or upgrading you all 
to first-class transatlantic travel. Once 
your child (or you) have had your game- 
playing fix, you can use the Activities 
wheel to get back to booking your 
holiday quickly. 


Getting Smart with Nepomuk 

The tab on the left of the 

screen reveals Plasma Active’s 
“Recommendations”: links to files, 
widgets and contacts that might be 
relevant to the current activity. This 

is based on Nepomuk, KDE's semantic 
storage technology, which draws links 
between items based on the context 
of their use. Marco explains that this 
enables “the information stored on the 


device by users to be kept in a central 
place, allowing them to treat in the 
same way and display in a coherent 
way everything, regardless if it is a file, 
a contact, a bookmark or information 
about a location, linking them 
together with semantic information”. 
What this means in practice is that the 
Recommendations are able to be more 
than a list of recently used or most- 
accessed files, suggesting documents 
that often are used at the same time 
as those presently open or often 

used within the current Activity (the 
recommendations are tailored to each 
Activity). While writing this article, it 
suggested some irrelevant items, but 
the system quickly learned to suggest 
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THE IDEA IS THAT THE SYSTEM LEARNS FROM 
ITS USER AND BECOMES EVER MORE USEFUL 
OVER TIME, AND BASED ON MY EXPERIENCE, 

I GIVE IT A CAUTIOUS THUMBS UP. 


SS €2 Writing 
Recommendations 


6 Images 
Open and add to the current activity 


Planet KDE 


“ Open and add to the current activity 


TheWall.JPG 


filex://0c32-51eb/pics/P1020514.JPG 


Open and add to the current activity 


Plasma Active - Google Search 


& Open and add to the current activity 


Concept Active.jpg 


Open and add to the current activity 


Figure 4. Plasma Active provides 
Recommendations of files and actions that are 
relevant to the task you are working on. 


screenshots | had collected and 
suggested adding the Linux Journal 
author guidelines and Plasma Active 
Wiki pages to my bookmarks. The idea 
is that the system learns from its user 
and becomes ever more useful over 
time, and based on my experience, | 
give it a cautious thumbs-up. 
Nepomuk has, since it was first 
introduced in KDE software in 2008, 
been the target of many complaints 
about resource usage, something that 
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Open and add to the current activity B 


is likely to be of even greater concern 
on a low-powered portable device. 
Marco, however, points out that “on 
a mobile device the stored data Is 
very small compared to a desktop, 
and measurements have shown that 
with the limited number of items in it, 
the memory usage stays very small”, 
while, of course, using a central 
Store also “avoids the necessity to 
build different storage/indexing for 
every application”. Aaron agrees: 
“the devices we currently target are 
all in the 600MHz to 1GHz range 
with 256MB or more of RAM. On 
these devices, it works acceptably”. 
Nevertheless, the developers 

have been working on “numerous 
optimizations and improvements”, 
and Aaron acknowledges there is 
always the possibility of “stripping 
out Nepomuk for some very low- 
end, in terms of hardware and user 
interaction, scenarios”. | did not 
come across any of the slowness that 
sometimes accompanies extensive 
indexing on the desktop. 


It’s All about the Apps 
The basic user interface seems slick and 
well thought out, and through Activities, 


6 of 37 QQ 


Figure 5. The applications that already have been adjusted for use with Plasma Active, such as the 


image viewer, work well. 


it does offer something different from 
the competition. However, a computer 
is only as good as its applications, and 
if Plasma Active is to be a success, KDE 
must provide a compelling suite of 
touch-friendly applications. 

A few “Active” variants of 
established KDE applications already 
are available. These include those 
that have been largely designed from 
the ground up for Plasma Active, 
such as the Web browser and image 
viewer, both of which were easy to 
use. Some other applications, such 
as the media player Bangarang, 
have received modifications to make 
them a little more touch-friendly. 


There are dedicated Active versions 
of the Kontact suite of groupware 
applications. Each of these are easy 
to use with a stubby finger, but their 
interfaces are so different from their 
desktop counterparts that even if 
you are an experienced Kontact user, 
you will find they take a little getting 
used to. Calligra, KDE’s productivity 
Suite, also is available in an Active 
version, but it felt slow on the device 
| used. However, Calligra’s underlying 
technology already has been used in 
the successful FreOffice viewers for 
Nokia’s mobile phones, so it is likely 
the performance will improve. 

Some other applications, such as 
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Figure 6. The on-screen keyboard is easy to use and can be moved out of the way when needed. 
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Dolphin (the KDE file manager), have 
not been adapted for touch-friendly 
use—and it shows. A similar interface 
is used in the Open and Save dialogs 
of most applications, but these will all 
be improved in future versions. 

The most essential of applications 
on a tablet, the on-screen keyboard, 
works very well with easy-to-touch 
buttons and a sensible layout. It 
appears when needed, and it can be 


Introduction 


Writing 


switched from the bottom to the top 
of the screen if desired. 


Share, Like, Connect 

Another new feature in Plasma Active 

is the presence of Share, Like and 
Connect buttons in the top panel. These 
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Games 


_ Vacation planning 


Figure 7. You easily can associate a file or Web 
page with an Activity by using the Connect button. 


make it easy to share content instantly, 
such as images, to social networks 

or on-line storage; “like” things on 
either social networks or locally (for 
example, bookmarking a page); and 
connect things together, such as linking 
a document or a page to the current 
Activity so that it always will be readily 
available in the future. This way, if you 
want quick access to an image, just click 
the Connect icon to add it as a widget 
on the desktop of the present Activity. 


Open for Business 

Plasma Active has been unusual 
among KDE projects due to the heavy 
involvement of companies from the 
start. Among these, basysKom has 
employed developers to work on 
Contour, the combination of Activities 
and Recommendations at the center 
of the user experience. Marco states 
that “everyone from the community is 
welcome to join and contribute, just 
like any other KDE project—companies 
are members of the community as 
well and are helping in many tasks 
(also the less fun ones in order to 
give to it the level of quality needed 
for an actual product)”. Companies 
also are making It easy to try Plasma 
Active, with live images provided by 
basysKom and open-slIx (see the Try 
Plasma Active Two sidebar). 


Life after MeeGo 
In the past, a large part of KDE’s 


focus in the mobile space has been on 
MeeGo-powered devices, particularly 
those created by Nokia. However, the 
decision of Nokia to use Windows 

as the base for its smartphones and 
Intel’s subsequent dropping of MeeGo 
in favor of its collaboration with 
Samsung, Tizen, has changed things. 
These changes do not, however, 
unduly concern the KDE developers. 
Aaron points out that “Plasma Active 
is not welded to any one OS and is 
highly portable”, and indeed, there 
are “images with OpenSUSE, MeeGo 
and Mer kernels and userlands 
beneath the Plasma Active UI”. 

ARM devices running Android have 
proven to be very popular, and Plasma 
Active also is targeting some of this 
hardware, with an ARM-ready image 
already available built on software 
from the Mer Project. But what about 
Android itself? It is not presently the 
most appealing alternative for Marco, 
who argues that “Android, while 
released with an open-source license 
is tightly controlled by Google and 
doesn’t leave much room for a developer 
community to grow and contribute”. 

He does, however, acknowledge that 
Android “is a good platform indeed and 
we don’t exclude some integration work 
with it in the future”. 

There also are possibilities of 
Plasma Active or related technologies 
targeting much more than just 
tablets. Aaron notes that already 
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“some are running it on handset-style 
devices”, but that “the current user 
experience has been designed with a 
tablet in mind”. He plans, however, 
to start working on “interfaces that 
are designed specifically for other 
form factors, such as set-top boxes 
and handsets in the future”. A key 
enabler for this is Plasma’s design: 
“Plasma allows for multiple, and 
highly diverse, user interfaces without 
starting from scratch. Plasma Desktop, 
Netbook and now Active for tablets 
showcases this very nicely: they are 
all very different on the surface from 
each other, but share nearly all the 
implementation code beneath.” 


The Future of Plasma Active 
Plasma Active is still young software. 
Plasma Active Two was released 
shortly before this article was written 
and is the version discussed here. 
Plasma Active Three is expected in 
summer 2012 and “will be focusing 
on new major feature and application 
introductions”, according to Aaron. 
From a purely end-user perspective, 
the limited number of touch-friendly 
applications means Plasma Active is 
not ready yet. Nonetheless, it is well 
worth trying out and could become 
compelling by the time of its third 
release later this year. It already feels 
more polished and complete than any 
of the MeeGo tablet pre-releases. 
There are other reasons to get 
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excited about Plasma Active. For 
Marco, the motivation for starting 
work on Plasma Active had “different 
reasons, both purely technological 
and social ones”. The social ones are 
perhaps best summed up by Aaron: 
“right now, there is too much focus on 
created devices that serve the owner 
of the application store and focus 

on consumption of new devices just 
for the sake of the newness of the 
device”, something he believes has 
“largely stalled progress”. 

Aaron sees a different future for 
Plasma Active and those who choose to 
contribute to or use the software: “We 
should be looking at how to support 
people's lives and in doing so make 
them better. This needs to be done in 
a socially responsible manner, which 
means free and open-source software 
as well as open processes must drive 
the development. This is the point and 
ourpose of Plasma Active.” ™ 


Stuart Jarvis is a technology writer and member of the KDE 
community. He has had a tablet computer for the past six months 
and has been trying very hard to find a use for it. 


Resources 
Plasma Active: http://plasma-active.org 
Plasma Active Installation: 


http://community.KDE.org/Plasma/ 
Active/Installation 
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Seamlessly 
Extending 
IRC to 
Mobile 
Devices 


IRC is still popular among techies, but it’s not friendly 
to mobile devices. Here are some tips on making it more 
effective when you’re on the run. 


BILL CHILDERS 


INTERNET RELAY CHAT (IRC) © very vibrant user base today. Personally, 


is one of the older real-time communications I’ve been on IRC since the late 1990s, 
methods still in active use on the and it's been very useful and lots of 
Internet. Due to its popularity, flexibility fun—particularly the #linuxjournal room 
and cross-platform nature, it still has a on Freenode—stop in sometime! 
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Drawbacks to IRC 

As great as IRC can be, there’s one 
thing about it that’s always bothered 
me, and it’s something that Jabber 
got right—the concept of a resource 
and priority. In IRC, when you log 

in aS whatever user you are, you 
can’t log in as that user again from 
another machine. Jabber allows 
multiple user logins, so long as the 
“resource” is different, and it'll route 
your messages to the client with the 
lowest priority. IRC doesn‘t even have 
that concept, so once you log in on 
your desktop, you have to log in as 
another user if you want to log in on 
your laptop, which results in lots of 


logins like “WildBill|Laptop” and such. 


This causes a problem if people want 

to private-message (PM) you, as they 

never know what login you're on. 
For years, I’ve used a fairly common 

workaround to bypass this problem 

to a certain degree. If you use a text- 

based client like Irssi, and run that 

client on a machine that’s on all the 

time, you can run the client within 

a terminal multiplexer, such as GNU 

Screen. That gives you the ability 

to run the client, detach from the 

terminal session, then log in via SSH 

on another machine and reattach to 

your session, where you can catch 

up on what you may have missed. 

By and large, this is an acceptable 

workaround...except when | forget to 

log in to that Screen session. I’ve been 


known to have a few days’ worth of 
PMs piled up before | remember to log 
in and check. By that time, people who 
PM'd me probably forgot what they 
pinged me about. 

The other major flaw with this 
scheme is that it doesn’t work well 
with mobile devices like tablets and 
mobile phones. Yes, | could SSH from 
my iPhone to my Linux server and 
attach to that Screen session with 
Irssi running in it, but a terminal 
emulator on a 3.5" screen, where a 
good portion of the screen is taken up 
with an on-screen keyboard, is a recipe 
for a headache. There are excellent 
IRC clients for mobile phones, like 
Colloquy on the iPhone, Yaaic for 
Android and wlIRC for WebOS, but if 
you run them while you have a Screen 
session going, you're back to the same 
problem mentioned above where you 
wind up with a “WildBill/Phone” login. 
There simply had to be a better way. 


Is There a Better Way? 

It turns out, after noodling around 

for a while one day, | did find a way. 
Irssi, the text-mode client | usually use 
via Screen and SSH, has a “proxy” (or 
“bouncer”) mode where you can have 
it listen on a couple additional ports 
and then attach another IRC client to 
it. Enabling the proxy is relatively easy, 
and it can be done from within Irssi 
with only a few commands (assuming 
your Irssi is packaged and includes the 
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proxy module). This also assumes you 
have Irssi already configured to work 
properly with whichever IRC networks 
you wish. Of course, substitute your 
own password for “mypassword”, 
define whatever IRC networks you 
want to proxy with Irssi, and pick an 
arbitrary open port on which to have 
the proxy listen: 


/LOAD proxy 

/SET irssiproxy_password mypassword 
/SET irssiproxy_ports Linuxjournal=9000 
/SAVE 


Once you get the proxy module 
running successfully, connecting to it is 
as easy aS pointing another IRC client 
at it. Just specify the fully qualified 
domain name of the host running your 
Irssi client in your second IRC client’s 
configuration, and give it the password 
and ports you called out in the Irssi 
commands above. This client can be a 
“regular” desktop or laptop, or it can 
be a mobile device, such as an Android 
phone or an iPad running an IRC client. 

Although this works just fine, it 
bothers me a little bit, as the password 
that’s sent between the mobile device 
and your Irssi session that’s running 
in Screen is sent in the clear. I'd much 
prefer that to be SSL-encrypted, so 
no one can intercept that password. 
Unfortunately, the Irssi proxy module 
doesn’t support SSL, but there’s a way 
around that through the use of the 
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stunnel utility. 

Stunnel is a generic encryption 
wrapper that’s designed to add SSL 
encryption to any non-encrypted 
service. It’s not hard to wrap the Irssi 
proxy service with stunnel. First, to 
prevent anyone on the outside from 
accessing the proxy without SSL, | 
bound the ports on the Irssi proxy 
to the loopback interface using the 
following Irssi command: 


/SET Arssiproxy. bind 127,0.90.1 
/ SAVE 


Next, use your distribution’s method 
for installing stunnel. On Ubuntu 
10.04, a simple sudo apt-get 
install stunnel4 took care of 
that. | had to create a self-signed 
SSL certificate (see Resources for a 
how-to on this), and |! put that cert 
in /etc/stunnel. Next, | had to create 
an /etc/stunnel/stunnel.conf that 
referred to the certificate | created and 
specified the Irssi proxy in the stunnel.conf 
file. An example follows below (adjust 
the file paths, “accept” IP address and 
port as necessary): 


; stunnel.conf code snippet 

; Certificate/key is needed in server mode and optional in client mode 
cert = /etc/stunnel/cert.pem 

key = /etc/stunnel/key.pem 

{Linuxjournal] 

accept=123 .123.123.123:9000 


connect=127.0.0.1:9000 


So, what the previous code snippet 
does is specify the cert/key file for 
the self-signed SSL cert, then binds 
the SSL side of stunnel to the external 
IP address 123.123.123.123 on port 
9000, and it'll hand off packets to 
my Irssi proxy running in the clear on 
127.0.0.1 (localhost) on port 9000. 
The last adjustment to this setup 
would be to go to the mobile device 
and specify that the IRC connection 
should be SSL, and now | have a secure 
proxy | can attach to with any client 
of my choice. Now | can log in to IRC 
from my regular Irssi client, but then 
when I’m on my phone, | can use 
the friendlier interface that Colloquy 
provides, all without having different 
nicknames on IRC. 


Being “Pinged” and Getting Alerted 

| still have a problem though. | still 
forget to log in to IRC and check my 
private messages—and some friends 
stack up many “pings” before they 
finally give up in frustration. | got 
to thinking and realized that since 
I'm on a mobile phone, it might be 
possible to send an e-mail to the 
SMS gateway my mobile provider 
runs when | get a PM. That'd give 
me a reminder to log in to IRC in the 
event that | forget. After searching 
the Internet for a bit, | discovered 
some other fellow had much the 
same idea. Michael Lustfield explains 
it on his blog in far more detail than | 


Messaging 


12/31 3:02PM => 


1 (410) 000005 TEXT ¥ 


FRM:irssi@cloud.nulldevice.n 
et SUBJ:[irssi-proxy] 
MSG:<linuxnoob!~S@216.13 
9.8.2@#linuxjournal> Yeah, 
well, EvilBill can be a total 


jerk. i) 


és 


Figure 1. Getting an SMS on WebOS 


can put in this article (there's a 
link in the Resources section), but 
I'll summarize his technique here. 
He’s got two Irssi scripts he uses: 
screen-away.pl monitors if there’s an 
active connection to the Irssi proxy, 
and awayproxy.pl sends any highlights 
off to a designated e-mail address if 
there isn’t an active client connected 
to the Irssi proxy. 

“But Bill...e-mail isn’t an SMS!” You 
may think that, but just about every 
mobile carrier can accept SMS messages 
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for delivery to a mobile phone via 
e-mail. In my case, | use AT&T, so 

any e-mail sent to <myphonenumber> 
@txt.att.net will arrive as a text 
message on my phone. So, all | have to 
do is drop Michael's scripts in my Irssi 
scripts folder, adjust awayproxy.pl so 
that the $config{emailto} variable 
ismymobilenumber@txt.att.net, 
and then activate both scripts from 
within Irssi by doing a /script 

load awayproxy.pl and /script 


12/31 3:06 PM 


#linuxjournal 


--> EvilBill (bill@proxy) has joined #linuxjournal 


Topic for #linuxjournal is "Welcome to the 
social channel for Linux Journal - The Original 
Magazine of the Linux Community : 
www.linuxjournal.com | Ops (@) are LJ Staff 
Subscribe: tinyurl.com/ljsubs | Write for LJ: 
goo.gl/bOkOj | JustinBot Help: !bot | Harmful 
commands must have a disclaimer. | Epithets 
Kickban | Happy Holdays!" 


EvilBill: |'m a what? 


a0 & 


Figure 2. Jumping into the Conversation—Using 
wIRC on WebOS 
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load screen-away.pl. Now, any 
mention of my name in any of the 
channels | sit in will cause an SMS to 
be fired off to my phone, and | can log 
in from my phone or tablet and jump 
into the conversation. 


We Can Rebuild It, We Have the 
Technology... 

This solution, although totally usable, 
isn’t quite as elegant as I'd like. My 
“main” tablet and phone are both iOS 
devices (iPad and iPhone, but let’s not 


9:05. 


Hold On 


al AT&T > 94% [> 


Colloquy 
oe greenfly — Hey, you there? 


Figure 3. Getting a Push Notify on an iPhone 


discuss my choice of mobile devices 
here), and Apple has a very clean, 
integrated push notification system. 

| started poking around to see if there 
was any way to send push messages 
to my iDevices rather than rely on 
SMS—that way my iPad would receive 
IRC “pings” as well. 

It turns out, the Internet already 
had an answer for this problem as 
well. A fellow named Chris Jones 
already put together a patched version 
of Irssi and an Irssi script that does 
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all the heavy lifting for this solution. 
His Web page (see Resources) talks all 
about the details on this and how to 
install it. He even mentions using Irssi 
with stunnel! 

In closing, utilizing this set of scripts 
has really brought IRC into the 21st 
century for me. | love the idea of IRC, but 
it shows a lack of mobility features due 
to its age. With this set of scripts and the 


> O $ 96% i 


ai__AT&T > 1:47 PM 


listening to something when you have walk-ups 
EvilBill: Yep. 

greently: with earbuds half the time people just 
walk up and start talking 


EvilBill: | have a pair of skullcandy cans | got 
from some IT vendor that | leave at work. 


EvilBill: I'm turning into a headphone whore 
greenfly: hence the big cans 
EvilBill: AYE. 


greenfly: well | just finished assembling my 
stroller/carseat/baby carriage system 
EvilBill: Maybe now is a great time for a 
screenshot. Smile, everyone!!! 


Colloquies 


Figure 5. Firing Up Colloquy to Join the 
Conversation 
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right mobile tools, you can bring your 
IRC addiction up to date—and have it 
with you, anywhere you go! ml 


Bill Childers is an IT Manager in Silicon Valley, where he lives 
with his wife and two children. He enjoys Linux far too much, 
and probably should get more sun from time to time. 


Resources 


Irssi Proxy Documentation: 
http://www.irssi.org/documentation/proxy 


Michael Lustfield’s Irssi-to-SMS Plugin Use: 
http://michael.lustfield.net/content/irssi-sms 


Chris Jones’ Irssi Proxy and iPhone: 
http://www.tenshu.net/2010/12/ 
old-and-new-mixing-irssi-and-iphones.html 


Stunnel Home Page: http://www.stunnel.org 


Generating a Self-Signed SSL 
Certificate: http://www.akadia.com/ 
services/ssh_test_certificate.html 


“Internet Relay Chat” by Jayson Broughton: 
http://www.linuxjournal.com/content/ 
internet-relay-chat 


“IRC, Still the Best Support Around” by Shawn 
Powers: http://www.linuxjournal.com/ 
content/irc-still-best-support-around 


Linux Journal IRC Channel: #linuxjournal 
on Freenode 
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Using Linux 


with EFI, Part Ill: 
Installing Linux on 
an EFI Computer 


This installment covers booting in EFI mode, quirks 
of different distributions in EFI mode and converting 
a BIOS-based installation to boot in EFI mode. 


RODERICK W. SMITH 


In Part Il of this series in the 
January 2012 issue, | described the 
prerequisites for installing Linux on 
a computer that uses an Extensible 
Firmware Interface (EFI) or Unified 
EFl (UEFI) as opposed to a more 
traditional Basic Input/Output System 
(BIOS) firmware. If you're lucky, 

you might be able to forego some 
of these preparatory steps, because 
your distribution’s installer might 
boot properly and manage the steps 
correctly. All too often though, 
Linux distributions handle these 
tasks poorly enough that you'll want 
to prepare your computer first by 
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partitioning manually and determining 
how to boot your computer in UEFI 
mode for installation—or in BIOS 
mode, in some cases. 

In this article, | look at the nuts and 
bolts of installing Linux on an EFl-based 
computer. The topics | cover are 
booting in EFl mode; quirks of Debian, 
Ubuntu, Fedora and OpenSUSE in EFI 
mode; and converting a BIOS-based 
installation to boot in EFl mode. 

My next article will conclude this 

series with a look at the tools and 
techniques you can use to troubleshoot 
and keep an EFl-based Linux installation 
working correctly. 


I’ve heard of some implementations that 
provide such poor control that the only way to 
switch modes is to employ tricks like rebuilding 
the installation medium to omit the files for the 
mode you don’t want to use! 


Booting in EFI Mode 
In most cases, launching a Linux 
installer on an EFl-based computer is 
just like launching the same installer 
on a BIOS-based computer. You insert 
the disc, boot the computer and 
perhaps select a boot-time option to 
boot from the optical disc rather than 
from a hard disk. On most UEFl-based 
PCs, you must be sure to use a 64-bit 
version of your distribution; the 32-bit 
versions usually lack EFI boot files, and 
such files generally are useful only on 
early Intel-based Macs in any event. 
Unfortunately, the fact that most 
EFl implementations provide a BIOS 
compatibility mode (also known as 
a Compatibility Support Module, or 
CSM) can make it hard to control 
whether your computer boots using 
EFl or BIOS mode. I’ve heard of some 
implementations that provide such poor 
control that the only way to switch 
modes is to employ tricks like rebuilding 
the installation medium to omit the files 
for the mode you don’t want to use! 
In most cases though, firmware boot 


options provide some way to launch 
the disc in one mode or another (as 
described in Part Il of this series). 

Some distributions, such as Debian, 
don’t yet ship with any EFI boot 
support, at least not for the x86-64 
platform. With such distributions, you 
have three choices: 


M You can install Linux in BIOS mode 
and continue booting in BIOS mode, 
ignoring the computer's EFI features. 


M You can install Linux in BIOS mode 
and then convert the working 
installation to boot in EFl mode, if 
this is necessary or desirable. 


M You can install an EF! bootloader on 
your hard disk or installation medium 
and use that to boot the installer in 
EFl mode. (Part Il of this series covered 
EFI bootloader installation.) 


Which method works best depends 


on your computer and your needs. 
For instance, BIOS-mode booting is 


WWW.LINUXJOURNAL.COM / MARCH 2012 / 95 


INDEPTH 


INDEPTH 


usually fine for a Linux-only installation, 
although it’s a bit slower than a native 
EF| boot. You even can use the GUID 
Partition Table (GPT) on your disks, if 
necessary. If you have a working EFl-mode 
Windows installation though, switching 
between EFI- and BlIOS-mode boots for 
the two OSes may be awkward. 

If you're not sure whether your 
distribution supports EFl-mode 
boot, you can check the files on the 
installation disc. Discs that support 
EFl-mode boots typically include files 
with names that end in “efi”, such as 
boot/x86_64/efi (OpenSUSE) or EFI/ 
BOOT/BOOTX64.efi (Fedora or, in 
all lowercase, Ubuntu). In actuality, 
EFl-bootable discs use a secondary 
El Torito entry, so these files might 
not be present in the main ISO-9660 
filesystem, but they usually are. If you 
don’t see such files, you can try booting 
the disc, but if it boots, you might be 
left with the question of whether it 
booted in BIOS mode or in EFI mode. 
To make this determination, try this: 


1. Boot the installation disc. 

2. Switch to a text-mode console by 
pressing Ctrl-Alt-F2 (or some other 
function key, if F2 doesn’t work). 

3. Type dmesg | grep EFI. 


If the dmesg command produces 
no output, or perhaps just one or two 
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lines, you've booted in BIOS mode. If 
the dmesg output includes numerous 
lines, most of which relate to memory 
mappings, you've booted in EFI mode. 
An example EFI boot might include lines 
like these (the full output is much longer 
than this): 


[ ©.Q00000] Command Line: BOOT_IMAGE= 
atapi2:\EFI\ELILO\bzImage-3.0.4 
root=/dev/seeker/ul104 ro 

[ 0.000000] EFI v2.00 by American Megatrends 

[ 0.000000] Kernel-defined memdesc doesn't match 
the one from EFI! 

[ 0.000000] EFI: mem00: type=3, attr=Oxf, range= 

[0x0000000000000000 -0x0000000000048000) 


(OMB) 


Once you've verified that you've 
booted in EFl mode, you can press Alt-F7 
(or Alt-F1 in Fedora) to return to the 
installer and proceed with installation. 
Alternatively, on some systems, it may be 
easier to install Linux in BIOS mode and 
then install an EFl-capable bootloader to 
enable the computer to boot in that way. 
Such a switch is especially likely to be 
useful with Debian and Ubuntu installs, 
as | describe shortly. 


Debian’s EFI Support 

As of version 6.0.3, you can install 
Debian on an EFI system in EFl mode, but 
only by adding your own EFI bootloader; 
the standard install DVD image lacks 

this critical feature. To do a native EFI 
installation, you can install ELILO (or 


Edit partition 


Edit a partition 


New partition size in 
megabytes (1000000 |250] 
bytes): 


Use as: 


| EFI boot partition 
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so you'll need to 
install an EFl-capable 
bootloader manually 
when you're done. 
Instead of installing 
Debian in EFl mode, 
v it’s usually easier and 
safer, particularly for 
multiboot systems, to 
install the OS in BIOS 


Format the partition: 


Mount point: 


Cancel 


Figure 1. Ubuntu identifies the ESP as an “EFI boot partition”. 


another bootloader, if you prefer) to the 
computer's EFI System Partition (ESP), 

as described in Part Il of this series. You 
must copy the vmlinuz and initrd.gz files 
from the disc’s install.amd subdirectory 
(assuming an x86-64 installation) as the 
kernel and initial RAM disk files. You can 


omit the roote= line in the elilo.conf file. 


Unfortunately, the reward for making 
this extra effort is an installer that runs 
but has some serious bugs, which are 
identical to those for Ubuntu. | describe 
them shortly in the Ubuntu section, 
because Ubuntu officially supports 
booting its standard installation discs 
in EFl mode. In addition, the Debian 
installer installs a BIOS version of GRUB, 


in | mode, install an EFI- 
enabled bootloader, 
and then switch the 
a computer into EFI 


boot mode to use the 
computer in this way. 
| cover this procedure 
in more detail later. 
Debian’'s 
repositories include 
ELILO (elilo), the 
EFl-enabled version of GRUB 2 (grub-efi) 
and rEFit (refit), so you can install any 
of these via packages. However, you will 
need to copy the relevant files to the ESP, 
as described in Part Il of this series. 


. 
} 


Ubuntu’s EFI Support 

As of version 11.10, Ubuntu can install 
directly in EFl mode, and on a single- 
boot computer, such an installation 

can work fairly well. One important 
caveat exists: if you use the advanced 
partitioning option (called “Something 
Else” on the “Installation Type” screen), 
you must identify the ESP as such by 
selecting the ESP, clicking Change and 
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selecting “EFl Boot Partition” in the 
“Use As” field, as shown in Figure 1. 
If you don't identify the ESP in this 
way, the installer won't install the 
bootloader to the ESP, rendering the 
system unbootable. If this happens, 
you can install a bootloader using an 
emergency boot system. 

Another problem is that if you don’t 
create an ESP before you begin the 
installation, Ubuntu creates one that’s 
on the small side—often well under 
100 MiB, depending on your hard disk’s 
size. Such a small ESP is fine if you use 
Ubuntu’s GRUB 2 bootloader, but not 
if you use ELILO. Thus, | recommend 
creating an ESP before you begin the 
Ubuntu installation process. 

More serious complications arise in 
a multiboot environment. Specifically, 
when you properly identify the 
ESP, Ubuntu creates a fresh FAT-16 
filesystem on the ESP. This has two 
undesirable consequences: 


@ If you install Ubuntu after another 
OS, the Ubuntu installation process 


destroys your existing OS's bootloader. 


@ If you install Ubuntu before Windows 
7, the Windows installer may not 
like the fact that the ESP uses FAT- 
16—Windows 7 is a stickler for the 
ESP being FAT-32. The result is that 
Windows either will complain that 
there’s no ESP or it will create a new 


ESP, proceed most of the way through 
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the installation and become confused 
late in the process. Either way, the 
result is a failed Windows installation. 


Several workarounds to this problem 


exist, such as: 


M You can install Windows (or any 


other OS) first, back up the ESP, 
install Ubuntu, and then restore 

the backed-up ESP files atop the 
Ubuntu ESP files. This procedure 
works well, but it leaves the ESP as 

a FAT-16 partition, which could cause 
problems if you need to re-install 
Windows in the future. 


You can install Ubuntu first, back up 
its ESP, create a fresh FAT-32 filesystem 
on the ESP, restore the ESP files, edit 
/etc/fstab to mount the ESP using its 
new UUID value, and then install your 
other OSes. 


You can install Ubuntu and 
deliberately not identify the ESP, 

or you Can install it in BIOS mode 
rather than in EFl mode. Either way, 
this will leave the ESP untouched. 
You then will have to install a 
bootloader manually. 


You can prepare a FAT-32 ESP, 

and when you install Ubuntu, 
deliberately not identify the ESP. 
Once you've passed the partitioning 
screen, press Ctrl-Alt-F1 to open a 


text-mode terminal and manually 
mount the ESP at /target/boot/efi. 
The installer then will add Ubuntu’s 
GRUB 2 to the ESP but leave its 
existing contents untouched. In 
many ways, this is the best solution, 
but it requires that you be prompt in 
manually mounting the ESP. 


By default, Ubuntu uses GRUB 
2 as its EFl bootloader, installed 
from a package called grub-efi. 
Ubuntu also provides elilo and refit 
packages, should you prefer one 
of these bootloaders; however, 
Ubuntu’s package management system 
includes scripts to update the GRUB 
2 configuration when you upgrade a 
kernel, and these scripts won't update 
an ELILO configuration. Thus, if you 
want the easiest configuration, GRUB 
2 has an edge. On the other hand, 
GRUB 2 is less reliable than ELILO, in 
my experience. Overall, | recommend 
you try GRUB 2, and if it gives you 
problems, switch to ELILO (with rEFIt, 
if necessary, to select a non-Linux OS). 


Fedora’s EFI Support 

Fedora 16 provides the most complete 
and reliable EFl support during 
installation of any of the distributions 
described here. Unlike Ubuntu, Fedora 
doesn't replace a working ESP with 

a new one; it adds its own files to 

the working ESP, as a well-behaved 
EFI OS installer should. Fedora does, 
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however, have a tendency to create 
ESPs that are on the large side—often 
well over a gigabyte. Also, if you 
install in BIOS mode to a GPT disk, 
Fedora mis-labels its /boot partition 
(or the Fedora root, /, partition if 
you don’t create a separate /boot 
partition) as an ESP. This last bug 
doesn’t affect native EFI installations. 
Fedora uses a modified version of 
GRUB Legacy on its EFI installations. 
(Fedora 16 has changed to GRUB 2 for 
BIOS installations, but has stuck with 
its modified GRUB Legacy for EFI.) 
This configuration works well on most 
systems in my experience. 


OpenSUSE’s EFI Support 

OpenSUSE 12.1 supports EFI 
installation, although the installer 
creates a new ESP even if a valid one 
already exists. What’s more, the ESP 
that OpenSUSE creates is a bit small 
(156 MiB) and is FAT-16. As noted with 
respect to Ubuntu, a FAT-16 ESP can 
cause problems if you subsequently 
attempt to install Windows on the 
computer. You can work around some 
of these problems by using the manual 
partitioning option, but that creates 
other problems if you're starting from 
scratch. For instance, the manual 
partitioner sets the wrong type codes 
on most of the partitions it creates, 
and you can only force it to create 

a FAT-32 filesystem by making the 
partition bigger than about 520 MiB. 
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GPT on BIOS 


Some EFl-capable firmwares have problems booting from GPT disks in BIOS 
mode because of BIOS bugs. You often can overcome this problem by setting the 
boot flag (aka the active flag) on the OxEE partition in the disk’s protective MBR, 
which is a part of the disk that’s intended to keep older GPT-unaware utilities from 
messing with a GPT disk. To do this, use Linux’s fdisk utility: 


1. Type fdisk /dev/sda to launch fdisk. 


2. Type a followed by 1 for the partition number. (The OxEE partition is almost 


always partition #1.) 


3. Type w to save your changes. 


Thereafter, the computer should boot fine in BIOS mode from the disk. Be aware that 
some GPT partitioning tools will undo this change, so you may need to re-enable 
it. Note that you should not attempt to use GNU Parted, GParted or any other 
libparted-based tool to do this; they won’t work. 


Therefore, if you need to dual-boot 
with Windows, it’s probably best to 
prepare your partitions before you 
run the OpenSUSE installer and then 
use the manual partitioning option to 


identify each partition to the installer. 


(You can identify the ESP by telling 
OpenSUSE to mount it at /boot/efi.) 

OpenSUSE uses ELILO as its default 
EFl bootloader. ELILO generally works 
well, in my experience. If you dual- 
boot with another OS, though, you'll 
need to replace or supplement ELILO, 
since it doesn’t support chainloading 
to another OS’s bootloader. 


100 / MARCH 2012 / WWW.LINUXJOURNAL.COM 


Converting an Existing System to 
Boot with EFI 

Because of the bugs in so many 
distributions’ installers’ EFl support, 
it's often better to install the OS in 
BIOS mode and then convert it to 
use an EFI bootloader than it is to 
install directly in EFl mode. You may 
need to perform such a conversion 

if you have a working system that 
you want to begin booting in EFI 
mode. Fortunately, Linux can switch 
between BIOS and EFI booting with 
no problems, provided you have both 
BIOS and EFI bootloaders installed. (If 


you're converting permanently, you can 
uninstall the BIOS bootloader when 
you're done with the conversion.) 

If you‘re starting from scratch, the 
easiest way to proceed is as follows: 


1. Partition your disk as described in 
Part Il, with a 200-300 MiB ESP 
and whatever partitions you need 
for Linux. If your distribution uses 
GRUB 2, you also should create a 
1 MiB BIOS Boot Partition, which 
is identified by a bios_grub flag in 
parted or GParted or by a type code 
of EFO2 in GPT fdisk (gdisk, cgdisk 
or sgdisk). 


2. Boot the Linux installer and verify that 
it’s running in BIOS mode. 


3. Install Linux normally. The result 
should boot in BIOS mode, but not in 
EFl mode. 


4. Mount your ESP at /boot/efi, creating 
that mountpoint if necessary. You also 
should create an /etc/fstab entry to 
make this configuration permanent. 


5. Install an EFl bootloader. Part II 
of this series described how to 
install ELILO, but you can install 
another bootloader if you prefer. 
If you install GRUB 2 using your 
distribution’s packaging system, 
the package name probably will 
be grub-efi, and it may replace the 


BIOS version of GRUB 2, grub-pc. This 
can render the computer unbootable 
in BIOS mode, so you should be 
careful if you use this option. Note 
that because efibootmgr won't work 
in BIOS mode, you'll probably have to 
install the bootloader as /boot/efi/EFI/ 
BOOT/bootx64. efi. 


6. Reboot and activate EFI boot 
mode in your firmware. With 
any luck, you'll see your Linux 
bootloader and be able to boot 
into Linux in EFl mode. If not, Part 
IV of this series will provide some 
troubleshooting tips. 


At this point, you can verify that you 
booted in EFl mode by examining your 
dmesg output, as described earlier. You 
then can add or change bootloaders— 
say, adding rEFIt if you want to dual- 
boot with Windows. 


Next Time 

Part IV of this series will cover tools 
and techniques to help keep your EFI 
Linux installation working correctly. 
Specific issues include kernel updates, 
dual-boot configurations and 
troubleshooting procedures. ™ 
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Roderick W. Smith is a Linux consultant, writer and open-source 
programmer living in Woonsocket, Rhode Island. He is the 
author of more than 20 books on Linux and other open-source 
technologies, as well as of the GPT fdisk (gdisk, cgdisk and 
sgdisk) family of partitioning software. 
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Rock Out with 
Your Console Out 


Playing and managing your music in text mode. 


REBECCA “RUJI” CHAPNIK 


Some of you probably have played 
audio files from the terminal with 
one-line commands, such as play, or 
even used the command line to open 

a playlist in a graphical music player. 
Command-line integration is one of the 
many advantages of using Linux software. 
This is an introduction for those who 
want the complete listening experience— 
browsing, managing and playing music— 
without leaving the text console. 

Thanks to the Ncurses (New Curses) 
widget library, developers can design 
text user interfaces (TUls) to run in 
any terminal emulator. An Ncurses 
application interface is interactive 
and, depending on the application, 
can capture events from keystrokes as 
well as mouse movements and clicks. It 
looks and works much like a graphical 
user interface, except it’s all ASCII— 
or perhaps ANSI, depending on your 
terminal. If you’ve used GNU Midnight 
Commander, Lynx or Mutt, you're already 
familiar with the splendors of Ncurses. 

An intuitive interface, whether 
textual or graphical, is especially 
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important in a media player. No one 
wants to sift through a long man 
page or resort to Ctrl-c just to stop 
an annoying song from playing on 
repeat, and most users (I’m sure some 
exceptions exist among Linux Journal 
readers) don’t want to type out a series 
of commands just to 1s the songs in 
an album's directory, decide which one 
you want to hear and play it, and then 
play asong in a different directory. 
If you've ever played music with a 
purely command-line application, such 
as SOX, you know what I'm talking 
about. Sure, a single command that 
plays a file is quite handy; this article, 
however, focuses on TUI rather than 
CLI applications. For many text-mode 
programs, Ncurses is the window (no 
pun intended) to usability. 
Note to developers: if you want 
to write a console music player, take 
advantage of the Curses Development 
Kit (CDK), which includes several 
ready-made widgets, such as scrolling 
marquees and built-in file browsing. 
Now, on to the music players! 


Select Add Group 
] Load/Add Playlist 
] Move Files After 
] Toggle File Display 


Move Files 


Global Playback: 
Next Song : 2??? (can't know yet) 

[Default] 
Predator Drone.mp3 


Shalom Chaverim.mp3 
Sea of Putridity.mp3 


[] Russian Paul - Sea of Putridity 


Figure 1. A Playlist in Mp3blaster 


Mp3blaster 

Mp3blaster was the first console 
music player | ever used. That was in 
2007, by which time it already was a 
mature and full-featured application. 
Its history actually dates back to 1997, 
before the mainstream really had 
embraced the MP3 format, let alone 
the idea of an attractive interface 
for controlling command-line music 
playback. Back then, it was humbly 
known as “Mp3player”. 

Despite the name, Mp3blaster supports 
several formats besides MP3s. Currently, 
these include OGG, WAV and SID. Keep 
an eye out for FLAC support in the 
future, as it is on the to-do list in the 
latest source tarball. 


Write Playlist 
Before 


Toggle Repeat 


Set Group Title 
Clear Playlist 
Start Search 

Toggle GroupShuffle 


Play current group, including subgroups 


[ <]+e8ex[ >] 


One nice feature of Mp3blaster 
is the top panel showing important 
keyboard shortcuts for playlist 
management. You can scroll through 
this list using + and -. There is also 
a useful chart on the right side that 
shows ASCII art playback symbols (such 
as |> for play) above their respective 
shortcut keys. Press ? for detailed help. 

You can customize any of the 
keybindings in your configuration 
file, which is usually located at 
~/.mp3blasterrc. | had to change 
several of these in order to use 
Mp3blaster in GNOME due to conflicts 
with my global hot keys. Mp3blaster’s 
default keybindings are better suited 
for use without X. 
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Figure 2. Herrie shows the current playlist on top and a file browser on the bottom. 


Herrie, meaning “clamour” in Dutch, 
was first released in 2006. Somehow it 
has escaped mention in many articles 
on console music players, but the Herrie 
community group on the music Web site 
Last.fm shows true fan dedication. 
Herrie is great for Last.fm users 
because it’s so easy to set up track 
scrobbling. Most of the music players in 
this article support scrobbling in some 
capacity—it's all open-source software, 
after all, and in theory, you can write a 
script to make anything do anything— 
but configuration is exceptionally simple 
with Herrie. All you have to do is put 
your user name and password in your 
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~/.herrie/config/herrie.conf file. Note that 
the password should not be in plain text; 
rather, you should type in the output 

of printf %s p4sswOrd | md5 as 
stated in the configuration file itself. 


Music on Console (MOC) is a good 
choice for music libraries that consist 
of OGG, WAV and MP3 files. It’s easy 
to use out of the box, boasting a 
two-paned interface similar to that 

of Midnight Commander, with a file 
browser on the left and your playlist 
on the right. The default keybindings 
are intuitive—mostly single letters that 
stand for what they do, such as n for 


® ©O@ moc [play] - 2 the Mountain Goats - Palmcorder Y... 
fhome/ruji/fMusiks Playlist 

The Knife - Geology {(Tomorron, 
the Mountain Goats — Palsacorder 
The et Underground - Pale B 
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Lady Gaga - Bad Romance (The Fa 
Purrbot - My Mess (Warm Gold) 
Deer Tick - Ashamed (War Elepha 
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Ace of Base/ 
Audiobooks_and_Lect 
AudioProjects/ 
Avril Lavigne/ 

Bear In Heaven/ 
Beyonce/ 

Bob Dylan/ 
Casiotone For The P 
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Celine Dion/ 

| Colby O*Donis/ 
Crash Test Dummies/ 
Deertick/ 
DJ Earworn/ 
Eurythmics/ 
Evis CosteLlLlo/ 
Face to Face/ 
Fever Ray/ 
fishes (plural)/ 
Flunk/ 

Playing... 


8:38 63:38 (84:88) = 44kHz 
a 


Figure 3. My Customized MOC Layout 


“next track” and R to toggle random 
play, so command-line newbies need not 
fear any Emacs-style digital acrobatics. 

MOC is my go-to Linux music player 
these days. It’s fast and slick, and it looks 
just how | want now that I’ve edited my 
~/.moc/config file to adjust the colors 
and the widths of each window pane. 
Another plus is its support for the JACK 
Audio Connection Kit (JACK). 

The command to start MOC Is mocp. 


Emacs + Bongo/EMMS 

If Emacs-style digital acrobatics are 
your modus operandi, check out Bongo 
and the Emacs Multi-Media System 
(EMMS). Both media players run inside 


128kbps [STEREO] 


Paster fam imal 988 :34247 
> 2 the Mountain Goats - Palmcorder Yajna (We Shall ALL Be Healed 


[SHUFFLE] [NEXT] 


Emacs and provide similar functionality. 
The main difference is that EMMS is 
designed to run unobtrusively in the 
background, while Bongo emphasizes 
the user interface. 

Bongo and EMMS are written in Emacs 
Lisp. You can install them the same way 
you'd install any other Emacs package; 
this may vary from distro to distro, but 
no matter what operating system you're 
using, you'll probably end up editing 
some Lisp configuration files. One of 
the first things to configure is your list 
of back ends. These programs don’t 
actually do the dirty work of playing 
your music files; rather, they are front 
ends for other programs. 
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Ey 


You can link any back end of your 
choice to a file type as well as pass 
custom command-line arguments. For 
example, one of the back ends Bongo 
recognizes by default is mpg123. If you 
want it to use, say, Mpg321 Instead, 
it’s just a matter of editing that line in 
your configuration file or using Emacs 
to access Bongo’s built-in customization 
dialog with M-x customize-group 
RET bongo RET. You can add a custom 


File Edit View Search Terminal Help 


back end with a few lines such as these: 


(define-bongo-backend mpg321 
:pretty-name "MPG-Thr33-Tw0-One" 
:extra-program-arguments '("--loop 0") 
:matcher '(local-file "mp3" "wav")) 
Although | use Emacs from time to 
time, I’m no guru; | admit that the time 
| spent with Bongo was flustering. For 
instance, | pressed Return to start playing 


File Edit Options Buffers Tools Bongo n&xhtml ECB Help 
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home h 
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HISTORY 
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our media collection is good to go (see below). 
started 
easy. 


README .rdoc 


Add the Bongo directory to your 
Git-master Fu 


Top L9 
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Figure 4. An Emacs session with the Bongo player in the bottom window, Bongo’s README in 
the top window and Emacs Code Browser (ECB) on the left side. 
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MPD is technically a server-side application; It’s 
great for setting up networked audio in a home 


media center. 


a track—easy enough—but then realized 
| didn’t know how to turn it off. | entered 
M-x apropos RETURN bongo and 
read through the list of Bongo commands 
until | found the one | needed: M- x 
bongo-stop. The GitHub home page 
reveals that you also can stop playback 
immediately with C-c C-s, and there 
are other key combinations for fancier 
tricks, such as 3 C-c C-s to stop 
playback after the next three tracks 
finish playing. 

That example is a fair representation 
of my whole experience with Bongo so 
far. It can be scary if you don’t know 
your way around Emacs very well, 
but it’s extremely powerful and full 
of options that you'd probably never 
thought of before. 

If you're a Vi/Vim fanatic, consider 
Vimmpc and Vimp3. 


MPD + Ncmpcpp 
In the vast universe of Linux audio, the 
Music Player Demon (MPD) could be 
considered a red giant. Chances are 
you've at least heard of it if you've done 
any research on playing music in Linux. It 
comes preinstalled in many distributions, 
and | have yet to find a major repository 
that doesn’t include it. 

MPD is technically a server-side 


application; it's great for setting up 
networked audio in a home media center. 
You also can use it simply for local 
playback. The advantage here is that you 
can use any client you want to control 
MPD, and there are many from which to 
choose. | easily could devote pages to 
discussing MPD, but that’s beyond the 
scope of this article. Documentation is 
easy to find on-line. 

Now, let’s move on to Ncmpcpp. This 
is an Ncurses MPD client, based on 
Ncmpc but more advanced. It includes 
support for Last.fm scrobbling and music 
visualization via external libraries. Lyrics 
fetching and display are built in and 
can be activated for a selected track 
by pressing I. The lyrics feature is, in 
fact, what attracted me to Ncmpcpp in 
the first place. I'd tried various scripts 
to fetch lyrics in other console music 
players, particularly MOC, but nothing 
worked for me until Ncmpcpp. Ncmpcpp 
can fetch artist information as well. 

Although Ncmpcpp is terrific once 
you get it set up, using an MPD client to 
listen to music isn’t always a pragmatic 
choice. You'll most likely be up and 
running much faster with a player like 
Mp3blaster, MOC or Herrie. 

I'm someone who likes to experiment 
with various Linux distributions by 
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the Mountain Goats 


We took a weekend, drove to Provo 
The snow was white and fluffy 


ZPBZ 


A weekend in Utah won't fix what's wrong with us 


The gray sky was vast and real cryptic above me 


I wanted you 
To love me like you used to do 


Went out dancing every night 
Tried to find the creeping s 
Most of the time I guess I f 


But I wanted you 
To love me like you used to do 


But you cannot run 


Figure 5. Ncmpcpp Showing Lyrics 


installing them on old computers and 
in virtual machines, and | often test out 
software in these environments. The truth 
about MPD is that a lot can go wrong. 
| let out a (silent) cheer every time | 
manage to install and use it successfully. 
Grappling with dependencies is half the 
battle, and configuring your system, 
especially your ~/.mpdconf file, is the 
other half. I’ve gotten it to work on some 
systems without a hitch, but more often 
than not, I've encountered problems and 
solved them through trial and error. 
Don't let this discourage you; MPD and 
its wide selection of clients are worth the 
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of dread with temporal things 


lright 


effort to set up if you take advantage 

of their features, and there are plenty 

of places to get help if you need it. The 
MPD man page is essential reading; 
beyond that, read through the official 
wiki and forums. Your distribution may 
provide documentation as well. Gentoo’s 
on-line wiki, for instance, has a lengthy 
section on MPD. 


Like MPD, XMMS2 is a demon 
you can control over a network, 
and there are various clients for 
it. The XMMS2 Wiki acknowledges 


Artists Albuns 
David Allen 
DD/MM/YYYY 

De Rosa 

Dead Can Dance 

Dead Kennedys 

Dead Meadow 

Dead Science 

Dear Reader 

Death Cab for Cutie 
Death In The Park 
Deception Pass 


Jepec 
Der Blutharsch 


Figure 6. Browsing Files in Ncmpcpp 


that the developers of these two 
applications have similar goals and 
that a collaboration could eventually 
be possible. For now though, they 
are separate packages with separate 
clients. Two text-mode XMMS2 
clients that caught my attention 
were Kuechenstation and CCX2. 
Kuechenstation is one 1337 music 
player. Okay, | was being mostly 
facetious there, but take one look 
at it, and you'll think “eighties 
demoscene”. (Kuechenstation actually 
has been around only since 2008.) 
It uses the FlGlet library to display 


the current song title in a scrolling 
marquee of oversized letters made 
from ASCII characters. 

The whole interface is attractive and 
friendly. You can navigate through 
several full-screen modes using 
keybindings that are helpfully listed 
at the bottom of the screen. These 
modes include playlist mode, artist 
information mode and podcast mode, 
to name a few. The podcast feature 
is especially notable; | haven't seen 
podcast support in any of the other 
music players discussed in this article. 
Kuechenstation helps you get started 
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Figure 7. Kuechenstation with My Customized Color Theme 


with a few pre-subscribed feeds, which 
are all in German. 

The Kuechenstation configuration 
file is located at ~/.config/xmms2/ 
clients/kuechenstation.conf. There you 
can choose your podcast subscriptions, 
interface colors and even the scrolling 
FiGlet font. 

CCX2, written in Python, is another 
solid XMMS2 client. Its command 
mode will come naturally to Vi/Vim 
users. All the standard playback 
and playlist management features 
are there: search, rename, browse, 
metadata display and so forth. 

So why did | decide to write about 
two TUI XMMS2 clients instead of just 
choosing the one with more features? 
My reasoning is, first of all, that the 
interfaces of Kuechenstation and 
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CCX2 are quite different, and each 
will appeal to different users solely on 
the basis of personal taste. Second, 
each has a major feature that the other 
lacks. CCX2 doesn’t come with podcast 
Support as Kuechenstation does, but it 
does support lyrics fetching out of the 
box, which Kuechenstation does not. 

| suggest trying them both. They 
are young and in active development, 
so there's a reasonable chance that a 
feature you're missing could be added 
in the future. And, of course, if you're a 
developer, you can try to add it yourself. 


nvic 

The famous VLC media player, 
known for its ability to play almost 
any media file you throw at it, 
comes with a lesser-known Ncurses 


PLAYING # Deer Tick > Diamond Rings 2007 -- War Elephant [@2:09/04:41] 


And I turn from sad to Glue = 
Yeah I° m choking after yau 
Miss, I"m choking now, do you? 


(Go ahead now, tell them all about it 
So what goad Would fingers be 

If it weren't For diamond rings? 

How I know you're Leaving me 

And I know that I"m no king 


1265639696 
oo EG eS 


Har Elephant 
Deer Tick 


Whole night through 


Figure 8. One of CCX2’s Lyrics Display Layouts 


control interface. To start it up, type LINUX JOURNAL 
nvic. The interactive features are ARCHIVE DVD 
noticeably limited in comparison 

with the vast array of options you ee archive:1ss4-20 | 
may be used to seeing in the GUI 

version. Press B to browse your 


files and Return to add a file to the 
playlist. Toggle help view with h for a 


complete list of hot keys. THE FIRST 
At first glance, nvic doesn’t seem all EIGHTEEN YEARS 


that special. It might not be for you if of LINUX JC 
you want a player that’s preconfigured 
with a hefty arsenal of hot keys, but 
you can do a lot with it—including 
adding custom hot keys—if you're 
willing to experiment. 

The path to nvic’s power is through 


command-line arguments. You can pass NOW AVAILABLE 


arguments ranging from a directory or 
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ruji@sabayonengine:~ 


Help 


x ruji@sabayonengine:~ x 


VLC media player 1.1.7? 


|}-10 Hatha Hill .mps 


|-19 Alpha Gelida.mp3 
1-28 Pure Sound.mp3 


|-26 Earth Air Water Trees.mp3 
|-15 Standard Bitter Love Song #6.mp3 


1-29 Going To Maine.mp3 
1-94 Song For John Davis.mp3 


05 Stars Around Her.mp3 
18 Going To Jamaica.mp3 


25 Going To Hungary.mp3 
98 The Only Thing I Know.mp3 


Figure 9. A Playlist in nvlc 


playlist (ala, nvlc /path/to/my/music) 
to complex chains of filters. Anything 
you can do in the GUI version of VLC 
is possible with nvic if you know which 
arguments to pass. 

Hint: enter nvlc -h for basic 
help, which is actually quite lengthy, 
or nvlc -H for even lengthier 
help. Enter nvlc --list to see 
what modules are available in your 
installation or nvlc --list-verbose 
for more-detailed output. 

For starters, try: 


nvlc --audio-filter chorus flanger --delay-time 150 


=--dry-mix 0.8 --wet-mix 0.6 --feedback-gain -0.3 


=»/path/to/my/music.fileextension 
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For the old-schoolers among you who 
collect modules—and perhaps scoff 
when you hear the phrases “MP3 
player” and “music player” used 
interchangeably—there is MikMod. 
MikMod is an old standby from pre- 
Windows Microsoft DOS. You can use 
it as a back end for other applications, 
such as Bongo or EMMS in Emacs, or 
as a Standalone module player. 
MikMod will play many module 
formats. If your file extensions include 
MOD, XM, IT or S3M, you're in luck. 
Sorry, MP3s—no MikMod for you, or 
for all you WAVs and OGGs and AIFFs. 
In a way, this is a bit sad, because I'd 


File Edit Miew Search Terminal Help 


-= MikMod 3.2.2-betal =- 

Disk writer (mav): 16 bit interpolated stereo, 44168 Hz, reverb: 9 
File: f#home/ruji/Ausiks/A80D/scart_cable xm 

Name = 

Type: Skale Tracker (23M format 1.64), Periods: XM type, Linear 
pat:816/6824 pos:3D spd: 671468 vol :1884%/188% time: 2244 4266 chn-=if/ 
H 5 I [¥oLune ] 


Figure 10. Instrument Levels in MikMod 
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options + /¥olurme [168] 


Figure 11. Some of MikMod’s Options 
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love to play my standard music files 

in a player as awesome as MikMod. 

| have to keep in mind that many of 
MikMod’'s features, such as on-the-fly 
tempo change and instrument-specific 
volume bars, are built specifically for 
module file formats. Perhaps this will 
be an incentive for me to make some 
sounds in MilkyTracker. 


Conclusion 

Many console music players are 
available for Linux. | chose the few 
| covered in this article based on my 
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level of experience with them and on 
what | considered to be unique and 
notable features. If the topic intrigues 
you, go out (or Google) and explore.m 


Rebecca “Ruji” Chapnik is a freelance creator of miscellanea, 
including but not limited to text and images. She studied art at 
the University of California, Santa Cruz, and book publishing 
at Portland State University. She went on to study Linux in 

her bedroom and also in various other people's bedrooms, 
crouched anti-ergonomically before abandoned Windows 
computers. Ruji currently lives in Portland, Oregon. You can 
find her experiments at http://rujic.net. 


Resources 

Ncurses: www.gnu.org/software/ncurses 
Mp8blaster: mp3blaster.sourceforge.net 
Herrie: herrie.info 

MOC: moc.daper.net 

Bongo: https://github.com/dbrock/bongo 
EMMS: www.gnu.org/software/emms 
MPD: www.musicpd.org 

Ncmpcpp: unkart.ovh.org/ncmpcpp 
Kuechenstation: kuechenstation.sourceforge.net 
CCX2: palbo.github.com/ccx2 

VLC: www.videolan.org/vic 


MikMod: mikmod.raphnet.net 
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DOC SEARLS 


Does Linux Have 
an Economy? 


How can you value something that isn’t scarce and costs nothing? 


ProjectVRM list, Joe Andrieu wrote 
this summary statement about 

economics and markets: “Economics Is 
about allocating limited resources. The 
market is a mechanism for discovering 
prices.” He then added, “You can 
allocate other ways, of course.” 

Although one might argue those 
definitions, they do explain why Linux, 
along with the rest of free software 
and open source, gets little attention 
in economics discussions and little 
credit for influence on markets—mostly 
because it allocates in other ways. 

Chief among those is use. Linux strives 
to be useful. But kernel development 
doesn't happen in userspace, which Is 
where economics and markets live. It 
happens in kernel space, which ts boring, 
unless you’re a contributor to it or you 
depend on keeping up with what's 
happening there. 

Even though the only code | know is 


} n the midst of a long thread on the 
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Morse, | often find reassuring the constant 
hum of progress coming off the Linux 
Kernel Mailing List (http://Ikml.org). The 
latest post today January 4, 2012, as | 
write this) concerns a patch for better low 
memory handling from Mike Waychison. 
The hottest message is one from Greg KH 
announcing the Linux 3.1.7 release, which 
has a single bugfix for resume issues, and 
which he says you won't need if those 
issues aren't yours. 

Maybe it’s just that | soent too much of 
my life in marketing and, therefore, love 
too much the sound of its absence, but | 
find in that kind of talk a reassurance that 
something right is going on in the world. 

Or, maybe it’s just that the instruction 
programmed into my head by my 
old-school parents—”“ make yourself 
useful”—remains a Platinum Rule, more 
valuable even than the Golden one, 
perhaps because it’s something you do 
for others, rather than “unto” them. 

It’s around “for” that Linux allocation 


Aclvertiser Inclex 


Thank you as always for supporting our 
advertisers by buying their products! 


succeeds. Linux has saturated the 
networked world (and our lives with it) 
with almost no help from marketing of 
the usual sort. Our collective dependence 
on Linux today verges on the absolute. 
Take Linux away from the world, and all 
but the most electronics-free markets 
would cease to operate. 

And still, because Linux is neither 
scarce nor sold, economics doesn’t know 
how to value it. Not exactly, anyway. That 
is, not in terms of costs or prices. 

Economics does have terms that 
cover the kind of stuff that Linux is, 
however. Two are non-rivalrous and 
non-excludable. Non-rivalrous means 
use of it by one party does not prevent 
another party from using it; non-excludable 
means it can’t be made scarce. Linux is 
both, making it what economists call a 
public good. Wikipedia sorts out rival/rous, 
excludable and their non- counterparts 
as shown in Table 1. 

This differs little from what it said 
when | posted the same table for 
“Greater Goods”, an essay for the 
December 2006 issue of Linux Journal 
(http://www.linuxjournal.com/ 
article/9344). Back then | noted: “Yet 
it seems that the purpose of free and 
open-source development is to produce a 
common pool resource. As Craig Burton 
has often observed, the idea is to create 
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Table 1. Rivalrous, Excludable and Their Non- Counterparts (from Wikipedia) 


EXCLUDABLE NON-EXCLUDABLE 


RIVALROUS Private goods: food, clothing, cars, 
personal electronics 


Common goods (common-pool 
resources): fish stocks, timber, coal 


common infrastructural building material 
that supports whole industries, rather than 
just one player in that industry. We do this 
by making goods that become abundant by 
being both open and in the public domain.” 

And we still do, as proven by the 
continuing progress of useful free and 
open code-making. But, as the T-shirt 
says, “Yes, it works in practice, but will 
it work in theory?” 

The best theories I’ve found so far are 
those of Yochai Benkler, Elinor Ostrom 
and Lewis Hyde. (Yochai and Lewis | 
know well. Elinor I’ve never met but 
would like to.) Yochai addresses the 
issue directly in Coase’s Penguin, or 
Linux and the Nature of the Firm. Elinor 
does so less directly in Governing the 
Commons: The Evolution of Institutions 
for Collective Action. Lewis’ latest and 
most direct approach Is in Common as 
Air: Revolution, Art, and Ownership. My 
own fave, however, is Lewis’ first book, 
The Gift: Creativity and the Artist in the 
Modern World, because it goes more 
deeply into the matter of motivation. 

In The Gift, Lewis makes a distinction 
between /ogos and eros. The first, he 
says, iS “reason and logic in general”, 
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teins ete me Club goods: cinemas, private parks, 
satellite television 


Public goods: free-to-air television, 
air, national defense 


and adds that “a market economy Is 
an emanation of Jogos”. The second is 
giving without expectation of exchange, 
or even of calculation. For example, the 
love we give to spouses and children, and 
the respect we give to friends, are gifts. 
To put a price on eros would violate its 
nature, and make it something else. 
“People live differently who treat a 
portion of their wealth as a gift”, Lewis 
writes. “To begin with, unlike the sale of 
a commodity, the giving of a gift tends 
to establish a relationship between the 
parties involved. Furthermore, when gifts 
circulate within a group, their commerce 
leaves a series of interconnected 
relationships in its wake, and a kind of 
decentralized cohesiveness emerges.” 
Clearly we have that, at least between 
those who create Linux and its conscious 
beneficiaries. Right now, that’s a superset 
of Linux Journal readers. Perhaps in time 
it will include economists and policy- 
makers as well. 


Doc Searls is Senior Editor of Linux Journal. He is also a fellow 
with the Berkman Center for Internet and Society at Harvard 
University and the Center for Information Technology and Society 
at UC Santa Barbara. 
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